2024-01-24T12:29:25.438 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-24T12:29:25.438 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766 --name vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/orig.config.yaml 2024-01-24T12:29:25.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T12:29:25.571 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766 branch: wip-vshankar-testing1-reef-2024-01-24-1150 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: vshankar@redhat.com first_in_suite: false job_id: '7530766' kernel: client: branch: testing flavor: default kdb: true sha1: f2d3460408951339ac0933340ad449487c9efddc ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-reef-2024-01-24-1150 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-reef-2024-01-24-1150 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 4668 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 sleep_before_teardown: 0 subset: 346/1024 suite: fs suite_branch: wip-vshankar-testing1-reef-2024-01-24-1150 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb31wdFe43Aa1vv7AEA/QSS11EbYkPsRg6DNznaQFtnvf/bWnxCrBiTddAC0G+za/PQ04nzCVHVUNNraA5qS2s= smithi124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBYZXbSRKtQbZIY8FOmZayvljdcrmTZ7kaFekOw3RtcO4qEoNCzhffAzxhdj5acEknJks6DwIhW0qI+XZI+Z1A= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPTmx7D2773Re/JDDuKb7FpIvc3l3oC1VzTSxIXrngDhgF2fmGOLFnXOiuZTOp4ZZ2WyxeAXw3wz8LHItMATaM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-24_12:12:30 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-24T12:29:25.572 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa; will attempt to use it 2024-01-24T12:29:25.572 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks 2024-01-24T12:29:25.572 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-24T12:29:25.574 INFO:teuthology.task.internal:Checking packages... 2024-01-24T12:29:25.599 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4e3182a65800aed6d4aa2f6b86da3cfd72188134' 2024-01-24T12:29:25.600 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-24T12:29:25.600 INFO:teuthology.packaging:ref: None 2024-01-24T12:29:25.600 INFO:teuthology.packaging:tag: None 2024-01-24T12:29:25.600 INFO:teuthology.packaging:branch: wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T12:29:25.600 INFO:teuthology.packaging:sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:29:25.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T12:29:25.743 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:29:25.744 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-24T12:29:25.752 INFO:teuthology.task.internal:no buildpackages task found 2024-01-24T12:29:25.752 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-24T12:29:25.819 INFO:teuthology.task.internal:Saving configuration 2024-01-24T12:29:25.836 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-24T12:29:25.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T12:29:25.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.320670', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKaQVSm7R8YAAhS/8sLxy3L5rcS5j26zqZnnCZjDcZEy'} 2024-01-24T12:29:25.985 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.318735', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKVQmaig0anwO8w4eXZPZkTBBEyIkWOBBklBriDfvOe1'} 2024-01-24T12:29:26.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.322008', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC45kdsRRxsqvoyUo40ZYDftZnq2vsOZKD3UxmoX2QrC'} 2024-01-24T12:29:26.003 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-24T12:29:26.052 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-01-24T12:29:26.052 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-24T12:29:26.052 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['client.0'] 2024-01-24T12:29:26.052 INFO:teuthology.run_tasks:Running task console_log... 2024-01-24T12:29:26.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56180cc0d0>, signals=[15]) 2024-01-24T12:29:26.272 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-24T12:29:26.297 INFO:teuthology.task.internal:Opening connections... 2024-01-24T12:29:26.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:29:26.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:29:26.386 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:29:26.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:29:26.465 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-01-24T12:29:26.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:29:26.545 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-24T12:29:26.556 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-01-24T12:29:26.562 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-01-24T12:29:26.563 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-24T12:29:26.608 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-24T12:29:26.609 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy 2024-01-24T12:29:26.609 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-01-24T12:29:26.633 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2024-01-24T12:29:26.639 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2024-01-24T12:29:26.639 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2024-01-24T12:29:26.691 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-24T12:29:26.692 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy 2024-01-24T12:29:26.693 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2024-01-24T12:29:26.716 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-01-24T12:29:26.722 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-01-24T12:29:26.722 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-24T12:29:26.769 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-24T12:29:26.770 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-24T12:29:26.770 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-24T12:29:26.770 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2024-01-24T12:29:26.770 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-01-24T12:29:26.800 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-24T12:29:26.814 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-24T12:29:26.913 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-24T12:29:26.913 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-01-24T12:29:26.916 DEBUG:teuthology.orchestra.run.smithi124:> test '!' -e /home/ubuntu/cephtest 2024-01-24T12:29:26.919 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-01-24T12:29:26.923 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-24T12:29:27.009 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-24T12:29:27.009 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-01-24T12:29:27.012 DEBUG:teuthology.orchestra.run.smithi124:> test -z $(ls -A /var/lib/ceph) 2024-01-24T12:29:27.014 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-01-24T12:29:27.033 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-24T12:29:27.165 INFO:teuthology.run_tasks:Running task kernel... 2024-01-24T12:29:27.219 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'} 2024-01-24T12:29:27.219 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-01-24T12:29:27.220 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-01-24T12:29:27.220 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T12:29:27.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:29:27.225 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-24T12:29:27.425 DEBUG:teuthology.task.kernel:sha1 for client.0 is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:29:27.425 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T12:29:27.425 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-24T12:29:27.430 INFO:teuthology.orchestra.run.smithi195.stdout:5.15.0-56-generic 2024-01-24T12:29:27.431 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:29:27.431 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T12:29:27.431 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-24T12:29:27.431 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-24T12:29:27.486 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git config --global init.defaultBranch 2024-01-24T12:29:27.616 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-24T12:29:27.617 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-24T12:29:27.617 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-24T12:29:27.617 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-01-24T12:29:27.617 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git branch -m 2024-01-24T12:29:27.617 INFO:teuthology.orchestra.run.smithi195.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-24T12:29:27.619 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-24T12:29:27.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-24T12:29:27.741 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-24T12:30:36.458 INFO:teuthology.orchestra.run.smithi195.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-24T12:30:36.459 INFO:teuthology.orchestra.run.smithi195.stderr: * [new branch] main -> origin/main 2024-01-24T12:30:36.490 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190312 -> 20190312 2024-01-24T12:30:36.490 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190416 -> 20190416 2024-01-24T12:30:36.490 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190514 -> 20190514 2024-01-24T12:30:36.491 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190618 -> 20190618 2024-01-24T12:30:36.491 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190717 -> 20190717 2024-01-24T12:30:36.491 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190815 -> 20190815 2024-01-24T12:30:36.492 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190923 -> 20190923 2024-01-24T12:30:36.492 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191022 -> 20191022 2024-01-24T12:30:36.492 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191215 -> 20191215 2024-01-24T12:30:36.492 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200122 -> 20200122 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200316 -> 20200316 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200421 -> 20200421 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200519 -> 20200519 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200619 -> 20200619 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200721 -> 20200721 2024-01-24T12:30:36.493 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200817 -> 20200817 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200918 -> 20200918 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201022 -> 20201022 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201118 -> 20201118 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201218 -> 20201218 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210208 -> 20210208 2024-01-24T12:30:36.494 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210315 -> 20210315 2024-01-24T12:30:36.495 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210511 -> 20210511 2024-01-24T12:30:36.495 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210716 -> 20210716 2024-01-24T12:30:36.495 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210818 -> 20210818 2024-01-24T12:30:36.495 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210919 -> 20210919 2024-01-24T12:30:36.495 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211027 -> 20211027 2024-01-24T12:30:36.496 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211216 -> 20211216 2024-01-24T12:30:36.496 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220209 -> 20220209 2024-01-24T12:30:36.496 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220310 -> 20220310 2024-01-24T12:30:36.496 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220411 -> 20220411 2024-01-24T12:30:36.497 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220509 -> 20220509 2024-01-24T12:30:36.497 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220610 -> 20220610 2024-01-24T12:30:36.497 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220708 -> 20220708 2024-01-24T12:30:36.497 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220815 -> 20220815 2024-01-24T12:30:36.498 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220913 -> 20220913 2024-01-24T12:30:36.498 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221012 -> 20221012 2024-01-24T12:30:36.498 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221109 -> 20221109 2024-01-24T12:30:36.498 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221214 -> 20221214 2024-01-24T12:30:36.498 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230117 -> 20230117 2024-01-24T12:30:36.499 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230210 -> 20230210 2024-01-24T12:30:36.499 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230310 -> 20230310 2024-01-24T12:30:36.499 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230404 -> 20230404 2024-01-24T12:30:36.499 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230515 -> 20230515 2024-01-24T12:30:36.499 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230625 -> 20230625 2024-01-24T12:30:36.500 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230804 -> 20230804 2024-01-24T12:30:36.500 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230919 -> 20230919 2024-01-24T12:30:36.500 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231030 -> 20231030 2024-01-24T12:30:36.500 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231111 -> 20231111 2024-01-24T12:30:36.500 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231211 -> 20231211 2024-01-24T12:30:36.501 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240115 -> 20240115 2024-01-24T12:30:40.558 INFO:teuthology.orchestra.run.smithi195.stderr:Updating files: 50% (1739/3429) Updating files: 51% (1749/3429) Updating files: 52% (1784/3429) Updating files: 53% (1818/3429) Updating files: 54% (1852/3429) Updating files: 55% (1886/3429) Updating files: 56% (1921/3429) Updating files: 57% (1955/3429) Updating files: 58% (1989/3429) Updating files: 59% (2024/3429) Updating files: 60% (2058/3429) Updating files: 61% (2092/3429) Updating files: 62% (2126/3429) Updating files: 63% (2161/3429) Updating files: 64% (2195/3429) Updating files: 64% (2227/3429) Updating files: 65% (2229/3429) Updating files: 66% (2264/3429) Updating files: 67% (2298/3429) Updating files: 68% (2332/3429) Updating files: 69% (2367/3429) Updating files: 70% (2401/3429) Updating files: 71% (2435/3429) Updating files: 72% (2469/3429) Updating files: 73% (2504/3429) Updating files: 74% (2538/3429) Updating files: 75% (2572/3429) Updating files: 76% (2607/3429) Updating files: 77% (2641/3429) Updating files: 78% (2675/3429) Updating files: 79% (2709/3429) Updating files: 80% (2744/3429) Updating files: 81% (2778/3429) Updating files: 81% (2790/3429) Updating files: 82% (2812/3429) Updating files: 83% (2847/3429) Updating files: 84% (2881/3429) Updating files: 85% (2915/3429) Updating files: 86% (2949/3429) Updating files: 87% (2984/3429) Updating files: 88% (3018/3429) Updating files: 89% (3052/3429) Updating files: 90% (3087/3429) Updating files: 91% (3121/3429) Updating files: 92% (3155/3429) Updating files: 93% (3189/3429) Updating files: 94% (3224/3429) Updating files: 95% (3258/3429) Updating files: 96% (3292/3429) Updating files: 96% (3320/3429) Updating files: 97% (3327/3429) Updating files: 98% (3361/3429) Updating files: 99% (3395/3429) Updating files: 100% (3429/3429) Updating files: 100% (3429/3429), done. 2024-01-24T12:30:40.563 INFO:teuthology.orchestra.run.smithi195.stdout:HEAD is now at 39adc8bd Merge branch 'robot/pr-0-1706036629' into 'main' 2024-01-24T12:30:40.581 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on client.0... 2024-01-24T12:30:40.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T12:30:40.802 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ 2024-01-24T12:30:40.803 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/ --input-file=- 2024-01-24T12:30:40.805 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-01-24T12:30:43.398 INFO:teuthology.orchestra.run.smithi195.stderr:2024-01-24 12:30:43 URL:https://1.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gf2d346040895/linux-image-6.7.0-gf2d346040895_6.7.0-gf2d346040895-1_amd64.deb [39079350/39079350] -> "/tmp/linux-image.deb" [1] 2024-01-24T12:30:43.398 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2024-01-24 12:30:43-- 2024-01-24T12:30:43.398 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 2.6s 2024-01-24T12:30:43.398 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 37M in 2.4s (15.7 MB/s) 2024-01-24T12:30:43.402 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on client.0... 2024-01-24T12:30:43.402 DEBUG:teuthology.orchestra.run.smithi195:> sudo dpkg -i /tmp/linux-image.deb 2024-01-24T12:30:43.664 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-6.7.0-gf2d346040895. 2024-01-24T12:30:45.788 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-24T12:30:45.794 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-24T12:30:45.932 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:30:49.348 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-6.7.0-gf2d346040895 (6.7.0-gf2d346040895-1) ... 2024-01-24T12:30:49.458 INFO:teuthology.orchestra.run.smithi195.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:31:11.560 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:31:11.579 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:31:11.603 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-01-24T12:31:11.958 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:31:11.986 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:31:12.321 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:31:12.334 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:31:12.402 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:31:12.407 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:31:12.562 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:31:12.562 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:31:12.562 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:31:12.609 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-01-24T12:31:12.789 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-deb -c /tmp/linux-image.deb 2024-01-24T12:31:12.796 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./ 2024-01-24T12:31:12.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./boot/ 2024-01-24T12:31:12.797 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4444641 2024-01-24 04:16 ./boot/System.map-6.7.0-gf2d346040895 2024-01-24T12:31:12.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 170154 2024-01-24 04:16 ./boot/config-6.7.0-gf2d346040895 2024-01-24T12:31:12.808 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11441152 2024-01-24 04:16 ./boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:31:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/ 2024-01-24T12:31:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/ 2024-01-24T12:31:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postinst.d/ 2024-01-24T12:31:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/postrm.d/ 2024-01-24T12:31:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/preinst.d/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./etc/kernel/prerm.d/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ 2024-01-24T12:31:12.828 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T12:31:12.831 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T12:31:12.832 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/ 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/ 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/ 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpuid.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/msr.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/ 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 353745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T12:31:12.833 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 881681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T12:31:12.834 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2276777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T12:31:12.846 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ 2024-01-24T12:31:12.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/af_alg.ko 2024-01-24T12:31:12.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_hash.ko 2024-01-24T12:31:12.846 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/algif_skcipher.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/ 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/ 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T12:31:12.847 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cryptd.ko 2024-01-24T12:31:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_simd.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lrw.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T12:31:12.849 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 149489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xts.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T12:31:12.850 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_extlog.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/ 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/apei/einj.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T12:31:12.851 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T12:31:12.852 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T12:31:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_legacy.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T12:31:12.854 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_radisys.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rz1000.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T12:31:12.855 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/ 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/ 2024-01-24T12:31:12.856 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/ 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/ 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 965377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/ 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 116329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/ 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/ 2024-01-24T12:31:12.857 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T12:31:12.931 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/ 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/applicom.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/ 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ 2024-01-24T12:31:12.932 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 148617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/ 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/nvram.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/ 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-24T12:31:12.933 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/ 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/ 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-palmas.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-si5351.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-twl6040.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/clk/clk-wm831x.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/ 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T12:31:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/ 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/ 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 517297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T12:31:12.935 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ 2024-01-24T12:31:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T12:31:12.937 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/ 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-gpio.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max14577.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max77693.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-max8997.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-palmas.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/ 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/ 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T12:31:12.938 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/ 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-arizona.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9052.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-da9055.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-dln2.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-generic.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-kempld.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max7300.ko 2024-01-24T12:31:12.939 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max730x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-max732x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-vx855.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-24T12:31:12.940 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/ 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-a4tech.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-apple.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-belkin.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cherry.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-chicony.ko 2024-01-24T12:31:12.941 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cp2112.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-cypress.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ezkey.ko 2024-01-24T12:31:12.942 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-generic.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kensington.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T12:31:12.943 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lg-g15.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-magicmouse.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-microsoft.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-monterey.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ntrig.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T12:31:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T12:31:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T12:31:12.946 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 269313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T12:31:12.947 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/ 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 217889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/ 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 305361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ 2024-01-24T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T12:31:12.949 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-24T12:31:12.950 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc2103.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T12:31:12.951 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hih6130.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T12:31:12.952 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/jc42.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T12:31:12.953 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T12:31:12.954 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T12:31:12.955 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T12:31:12.956 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T12:31:12.957 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T12:31:12.958 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T12:31:12.959 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/ 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/ 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/ 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-24T12:31:12.960 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T12:31:12.961 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-24T12:31:12.962 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/ 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ 2024-01-24T12:31:12.963 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 273625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 883809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 324433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 493273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/ 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 420625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/ 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 741577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T12:31:12.964 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 296977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 169017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 111433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ 2024-01-24T12:31:12.965 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/evbug.ko 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/ff-memless.ko 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/ 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T12:31:12.966 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/ 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-24T12:31:12.967 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8323.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/lm8333.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt1070.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/qt2160.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-24T12:31:12.968 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/stowaway.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/matrix-keymap.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/ 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-24T12:31:12.969 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 336017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/psmouse.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/ 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ct82c710.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T12:31:12.970 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/parkbd.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/pcips2.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/ps2mult.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serport.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/ 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-88pm860x.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-adp5520.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-bd2802.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da903x.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-da9052.ko 2024-01-24T12:31:12.971 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-gpio.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3533.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm355x.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3642.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp8788.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-max8997.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-mc13783.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca9532.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca955x.ko 2024-01-24T12:31:12.972 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-pca963x.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-tca6507.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-wm8350.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T12:31:12.973 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/ 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/ 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 647281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bufio.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 155921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-era.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log.ko 2024-01-24T12:31:12.974 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-mirror.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-region-hash.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-snapshot.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 181873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-zero.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T12:31:12.975 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/ 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 199985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 393793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/ 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/ 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 178145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T12:31:12.976 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm800.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm805.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/88pm80x.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona-i2c.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/arizona.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/bcm590xx.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/dln2.ko 2024-01-24T12:31:12.977 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/janz-cmodio.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/kempld-core.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-core.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lp3943.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/max8907.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/menf21bmc.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/pcf50633.ko 2024-01-24T12:31:12.978 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/retu-mfd.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/si476x-core.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps65010.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/tps6507x.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wm8994.ko 2024-01-24T12:31:12.979 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ad525x_dpot.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/ 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/ 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/c2port/core.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/ 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ds1682.ko 2024-01-24T12:31:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/dummy-irq.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/ 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/echo/echo.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/ 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/ 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hmc6352.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ics932s401.ko 2024-01-24T12:31:12.981 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/ 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/ 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 313689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/phantom.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/ 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T12:31:12.982 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 183665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 490897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-24T12:31:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 455153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/ 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T12:31:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-24T12:31:12.985 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/ 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1421585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T12:31:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 314561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 323793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 347313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1044921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-24T12:31:12.987 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/ 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 204417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/ 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T12:31:12.988 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/ 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/ 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 281161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T12:31:12.989 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 295505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 584553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 246273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 937761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-24T12:31:12.990 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 287345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/ 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 514617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 734457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 151793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/ 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T12:31:12.991 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 727585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 279017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1118433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/ 2024-01-24T12:31:12.992 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/ 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 150913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/ 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 136729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/ 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T12:31:12.993 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/ 2024-01-24T12:31:12.994 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-24T12:31:12.994 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 227929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T12:31:12.994 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T12:31:12.994 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-24T12:31:12.994 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 672009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/ 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/ 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 192369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/ 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-24T12:31:13.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/ 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1064929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/ 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/ 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/ 2024-01-24T12:31:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/ 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-24T12:31:13.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 487729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/ 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/ 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/ 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/ 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/ 2024-01-24T12:31:13.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/ 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/ 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/defxx.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/ 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 217073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/ 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 236257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/ 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T12:31:13.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/ 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T12:31:13.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/ 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T12:31:13.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/ 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/plip/plip.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T12:31:13.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sb1000.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/ 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T12:31:13.136 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/ 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/ 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/ 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 301305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T12:31:13.137 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 265809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/ 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-24T12:31:13.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pci-stub.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/ 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/ 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/ 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/ 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-24T12:31:13.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/ 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/ 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/ 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/ 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-24T12:31:13.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 132033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/ 2024-01-24T12:31:13.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/ 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-24T12:31:13.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9030_battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/da9052-battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-24T12:31:13.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/gpio-charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max14577_charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max17042_battery.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8903_charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/max8925_power.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/sbs-battery.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/test_power.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm831x_power.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/power/supply/wm8350_power.ko 2024-01-24T12:31:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/ 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/ 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/ 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/ 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T12:31:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9052.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9055.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-da9063.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T12:31:13.146 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8907.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8925.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8997.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max8998.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-24T12:31:13.147 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-palmas.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T12:31:13.148 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 135193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/ 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 271169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T12:31:13.149 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/ 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 356961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 296089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/ 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 189241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/ 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T12:31:13.150 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 247033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1172049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 237753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 308977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/ 2024-01-24T12:31:13.151 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/ 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 212481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/ 2024-01-24T12:31:13.152 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fdomain.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/ 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 263561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 201825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/imm.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 266545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/ 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 317217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T12:31:13.153 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/ 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 315257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 145593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/ 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 216497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/ 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2197561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/ 2024-01-24T12:31:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 310865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/ 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 659849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/ 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/ 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/ 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 366433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T12:31:13.155 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T12:31:13.156 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ppa.ko 2024-01-24T12:31:13.156 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T12:31:13.156 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/ 2024-01-24T12:31:13.156 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1876729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T12:31:13.156 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/ 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 559089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qlogicfas408.ko 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 261249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T12:31:13.157 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 279321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T12:31:13.158 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T12:31:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T12:31:13.160 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/xen-scsifront.ko 2024-01-24T12:31:13.160 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ 2024-01-24T12:31:13.160 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T12:31:13.160 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/ 2024-01-24T12:31:13.160 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/ 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 736865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/ 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 930785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T12:31:13.161 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/ 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/ 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/ 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T12:31:13.162 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/moxa.ko 2024-01-24T12:31:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/mxser.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/ 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/ 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/altera_uart.ko 2024-01-24T12:31:13.164 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/ 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/rp2.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/ 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 536009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/ 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T12:31:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_mf624.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_netx.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/ 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/ 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-24T12:31:13.166 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/ 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/common/ulpi.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/ 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/ 2024-01-24T12:31:13.167 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 454425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/ 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/ 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 92497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-24T12:31:13.168 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/ 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-24T12:31:13.169 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 161265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/ 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-24T12:31:13.170 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 157705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-24T12:31:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811_cs.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-24T12:31:13.172 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/ 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/cytherm.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ehset.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T12:31:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/lvstest.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/ 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbtest.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T12:31:13.174 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/ 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/mon/usbmon.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/ 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 301737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/ 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T12:31:13.175 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/f81232.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 175201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 137089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T12:31:13.176 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/metro-usb.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mxuport.ko 2024-01-24T12:31:13.177 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 191809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T12:31:13.178 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33209 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usbserial.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T12:31:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19529 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 180265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/ 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T12:31:13.180 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/ 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/ 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 154321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/ 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/ 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/ 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-24T12:31:13.181 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/bd6107.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-24T12:31:13.182 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-24T12:31:13.183 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/ 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-24T12:31:13.184 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/ 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T12:31:13.185 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/acquirewdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/advantechwdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18569 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/dw_wdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-24T12:31:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18697 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T12:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/retu_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-24T12:31:13.188 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15705 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/ 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/ 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T12:31:13.189 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-scsiback.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 166817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/adfs/adfs.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 163489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/ 2024-01-24T12:31:13.190 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 935201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/afs/kafs.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/autofs/autofs4.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64721 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/bfs/bfs.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 3456161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 306057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1337105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T12:31:13.191 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/configfs/configfs.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 644161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/efs/efs.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/ 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1506745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T12:31:13.192 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/ 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/ 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/freevxfs/freevxfs.ko 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/ 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 226521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/ 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/ 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1230033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T12:31:13.193 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 223329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/hpfs/hpfs.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 420001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/ 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T12:31:13.194 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/ 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/ 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/ 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/ 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1058081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv2.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2042273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/ 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T12:31:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/ 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1564041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/ 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 590833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/ 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T12:31:13.196 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13801 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ascii.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T12:31:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 165753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T12:31:13.198 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T12:31:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T12:31:13.200 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T12:31:13.200 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T12:31:13.200 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T12:31:13.200 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T12:31:13.200 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 220641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ntfs/ntfs.ko 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 244777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 440785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2593689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T12:31:13.201 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/ 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/omfs/omfs.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/ 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 370753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/ 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx4/qnx4.ko 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/ 2024-01-24T12:31:13.202 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/qnx6/qnx6.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_tree.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v1.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/quota/quota_v2.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 532153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29001 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2683457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/ 2024-01-24T12:31:13.203 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/ 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/ 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/ 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 248505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 162585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/ 2024-01-24T12:31:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4014953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/ 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/ 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/locking/locktorture.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/ 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/time/test_udelay.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6841 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc7.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/ 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/interval_tree_test.ko 2024-01-24T12:31:13.205 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/ 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/ 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/memory-notifier-error-inject.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/notifier-error-inject.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/percpu_test.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/pm-notifier-error-inject.ko 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/ 2024-01-24T12:31:13.206 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/rbtree_test.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/ 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-kstrtox.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test-string_helpers.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4876641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_bpf.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_firmware.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_module.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/test_user_copy.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/ 2024-01-24T12:31:13.207 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/lib/xz/xz_dec_test.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/ 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/ 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7057 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 6993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T12:31:13.208 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/ 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/ 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/ 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 198929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/ 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 650097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T12:31:13.209 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/ 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 785945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13225 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T12:31:13.210 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11649 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/ 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1046889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T12:31:13.211 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/ 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/ 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 194593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/ 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 390185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7729 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T12:31:13.212 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/ 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/hsr/hsr.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 255897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T12:31:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-24T12:31:13.214 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T12:31:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T12:31:13.216 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11369 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39713 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T12:31:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_gre.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93985 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/mip6.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14145 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14281 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T12:31:13.218 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15129 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25233 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T12:31:13.219 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/ 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/ 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125313 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25961 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T12:31:13.220 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/ 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/lapb/lapb.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/ 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 268337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc2.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/ 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 290505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/ 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ 2024-01-24T12:31:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T12:31:13.222 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 412641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7745 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T12:31:13.223 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49273 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 411601 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T12:31:13.224 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11241 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10121 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10137 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11865 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T12:31:13.225 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 614153 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42617 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30489 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9609 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T12:31:13.226 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13681 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_osf.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_synproxy.ko 2024-01-24T12:31:13.227 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tproxy.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/x_tables.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18177 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13377 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38881 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13897 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T12:31:13.228 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11761 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11081 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10441 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13201 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T12:31:13.229 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10977 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8809 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10665 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T12:31:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11793 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10217 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11833 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10113 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T12:31:13.231 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9737 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7641 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8265 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16921 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9513 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T12:31:13.232 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8561 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15785 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpudp.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11073 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/ 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/ 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12433 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/ 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 383545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11937 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/ 2024-01-24T12:31:13.233 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13577 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/ 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112089 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/phonet.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54873 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/phonet/pn_pep.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/ 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 253033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164993 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/ 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 818929 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/rxrpc/rxrpc.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/ 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32249 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T12:31:13.234 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34105 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23409 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43457 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31969 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20297 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35305 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36673 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34361 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19289 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_cgroup.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32385 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T12:31:13.235 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40017 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61537 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7449 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33321 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7905 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21777 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20857 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34689 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35825 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31625 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq_codel.ko 2024-01-24T12:31:13.236 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49945 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22097 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66585 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30393 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10913 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26193 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36257 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27505 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10753 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24849 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48633 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T12:31:13.237 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26889 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31417 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28953 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28161 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/ 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 932329 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20353 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/ 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/ 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 336817 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55025 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1518553 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/ 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 708345 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T12:31:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/ 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10497 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 866465 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/ 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/ 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86425 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68065 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98041 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11185 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17769 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/ 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125473 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/x25/x25.ko 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/ 2024-01-24T12:31:13.239 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23049 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_algo.ko 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20657 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104169 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_user.ko 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/ 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/ 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15545 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 641009 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 625033 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7677 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23634 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.alias.bin 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9916 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70653 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 147734 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 234045 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T12:31:13.240 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 210 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72797 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 255175 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 309826 2024-01-24 04:16 ./lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/ 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/ 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/ 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/ 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 171 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/changelog.Debian.gz 2024-01-24T12:31:13.241 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 691 2024-01-24 04:16 ./usr/share/doc/linux-image-6.7.0-gf2d346040895/copyright 2024-01-24T12:31:13.242 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T12:31:13.242 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gf2d346040895 2024-01-24T12:31:13.242 DEBUG:teuthology.orchestra.run.smithi195:> egrep '(submenu|menuentry.*6.7.0-gf2d346040895).*{' /boot/grub/grub.cfg 2024-01-24T12:31:13.249 INFO:teuthology.orchestra.run.smithi195.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:31:13.249 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:31:13.249 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gf2d346040895 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gf2d346040895-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-24T12:31:13.250 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-24T12:31:13.250 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gf2d346040895 2024-01-24T12:31:13.250 DEBUG:teuthology.orchestra.run.smithi195:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-24T12:31:13.293 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-01-24T12:31:13.744 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-01-24T12:31:13.745 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-24T12:31:13.776 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-01-24T12:31:14.019 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T12:31:14.025 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:31:14.291 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-24T12:31:14.296 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-24T12:31:14.338 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-24T12:31:14.343 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-24T12:31:14.514 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-24T12:31:14.515 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-24T12:31:14.515 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-24T12:31:14.535 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-01-24T12:31:45.693 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-24T12:31:45.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:31:45.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:32:20.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-01-24T12:32:29.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:32:29.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:32:47.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-01-24T12:32:59.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:32:59.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:33:00.027 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-24T12:33:01.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:33:01.393 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-gf2d346040895"... 2024-01-24T12:33:01.393 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-01-24T12:33:01.447 INFO:teuthology.orchestra.run.smithi195.stdout:6.7.0-gf2d346040895 2024-01-24T12:33:01.447 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T12:33:01.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T12:33:01.447 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-24T12:33:02.449 DEBUG:teuthology.parallel:result is None 2024-01-24T12:33:02.449 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-24T12:33:02.457 INFO:teuthology.task.internal:Creating test directory... 2024-01-24T12:33:02.457 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T12:33:02.460 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T12:33:02.462 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T12:33:02.471 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-24T12:33:02.631 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-24T12:33:02.975 INFO:teuthology.task.internal:Creating archive directory... 2024-01-24T12:33:02.975 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T12:33:02.977 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T12:33:02.980 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T12:33:03.006 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-24T12:33:03.091 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-24T12:33:03.091 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T12:33:03.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:33:03.096 DEBUG:teuthology.orchestra.run.smithi124:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T12:33:03.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:33:03.101 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T12:33:03.141 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T12:33:03.147 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T12:33:03.161 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.173 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.179 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.195 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.231 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.253 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T12:33:03.256 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-24T12:33:03.263 INFO:teuthology.task.internal:Configuring sudo... 2024-01-24T12:33:03.263 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T12:33:03.266 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T12:33:03.268 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T12:33:03.287 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-24T12:33:03.358 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-24T12:33:03.358 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T12:33:03.361 DEBUG:teuthology.orchestra.run.smithi124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T12:33:03.363 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T12:33:03.371 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T12:33:03.412 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T12:33:03.460 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:33:03.460 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T12:33:03.523 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T12:33:03.529 DEBUG:teuthology.orchestra.run.smithi124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T12:33:03.578 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:33:03.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T12:33:03.643 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T12:33:03.652 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T12:33:03.704 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:33:03.704 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T12:33:03.785 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-01-24T12:33:03.787 DEBUG:teuthology.orchestra.run.smithi124:> sudo service rsyslog restart 2024-01-24T12:33:03.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-01-24T12:33:03.924 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-24T12:33:03.934 INFO:teuthology.task.internal:Starting timer... 2024-01-24T12:33:03.934 INFO:teuthology.run_tasks:Running task pcp... 2024-01-24T12:33:04.006 INFO:teuthology.run_tasks:Running task selinux... 2024-01-24T12:33:04.134 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2024-01-24T12:33:04.135 DEBUG:teuthology.task.selinux:Excluding smithi124: OS 'ubuntu' does not support SELinux 2024-01-24T12:33:04.135 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2024-01-24T12:33:04.135 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-24T12:33:04.135 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-24T12:33:04.135 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-24T12:33:04.135 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-24T12:33:04.270 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-24T12:33:04.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-24T12:33:04.288 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi124.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-24T12:40:21.629 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi124.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-01-24T12:40:21.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-24T12:40:21.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:40:21.716 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-01-24T12:40:21.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-24T12:40:21.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-24T12:40:21.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:40:21.904 DEBUG:teuthology.orchestra.run.smithi124:> true 2024-01-24T12:40:22.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2024-01-24T12:40:22.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:40:22.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T12:40:22.085 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-01-24T12:40:22.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-01-24T12:40:22.213 INFO:teuthology.run_tasks:Running task clock... 2024-01-24T12:40:22.224 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-24T12:40:22.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T12:40:22.224 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T12:40:22.227 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T12:40:22.227 DEBUG:teuthology.orchestra.run.smithi124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T12:40:22.229 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T12:40:22.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T12:40:22.257 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-24T12:40:22.257 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Command line: ntpd -gq 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: ---------------------------------------------------- 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: ntp-4 is maintained by Network Time Foundation, 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: corporation. Support and training for ntp-4 are 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: available at https://www.nwtime.org/support 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: ---------------------------------------------------- 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: proto: precision = 0.047 usec (-24) 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: basedate set to 2022-02-04 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: gps base set to 2022-02-06 (week 2196) 2024-01-24T12:40:22.258 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.259 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.259 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.259 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen and drop on 0 v6wildcard [::]:123 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen normally on 2 lo 127.0.0.1:123 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen normally on 3 ens1f0 172.21.15.27:123 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen normally on 4 lo [::1]:123 2024-01-24T12:40:22.260 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%4]:123 2024-01-24T12:40:22.261 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:22 ntpd[17362]: Listening on routing socket on fd #22 for interface updates 2024-01-24T12:40:22.261 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-24T12:40:22.261 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Command line: ntpd -gq 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: ---------------------------------------------------- 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: ntp-4 is maintained by Network Time Foundation, 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: corporation. Support and training for ntp-4 are 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: available at https://www.nwtime.org/support 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: ---------------------------------------------------- 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: proto: precision = 0.045 usec (-24) 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: basedate set to 2022-02-04 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: gps base set to 2022-02-06 (week 2196) 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.262 INFO:teuthology.orchestra.run.smithi124.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.263 INFO:teuthology.orchestra.run.smithi124.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.263 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen and drop on 0 v6wildcard [::]:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen normally on 2 lo 127.0.0.1:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen normally on 3 enp3s0f1 172.21.15.124:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen normally on 4 lo [::1]:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5c5%5]:123 2024-01-24T12:40:22.264 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:22 ntpd[17283]: Listening on routing socket on fd #22 for interface updates 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Command line: ntpd -gq 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: ---------------------------------------------------- 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: ntp-4 is maintained by Network Time Foundation, 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: corporation. Support and training for ntp-4 are 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: available at https://www.nwtime.org/support 2024-01-24T12:40:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: ---------------------------------------------------- 2024-01-24T12:40:22.294 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: proto: precision = 0.042 usec (-24) 2024-01-24T12:40:22.294 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: basedate set to 2022-02-04 2024-01-24T12:40:22.294 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: gps base set to 2022-02-06 (week 2196) 2024-01-24T12:40:22.294 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.295 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-24T12:40:22.295 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.295 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen and drop on 0 v6wildcard [::]:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen normally on 2 lo 127.0.0.1:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen normally on 4 lo [::1]:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2024-01-24T12:40:22.296 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:22 ntpd[16836]: Listening on routing socket on fd #22 for interface updates 2024-01-24T12:40:23.258 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:23.259 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:23 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:23.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:23.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:23.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:23 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:24 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:25 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:25 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:25.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:25.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:25.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:25.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:25 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:26.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:26 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:26.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:26 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:27 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:27 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:27.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:27 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:28.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:28 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:28.293 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:28.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:28.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:28.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:28.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:28.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:28 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:29 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.260 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stdout:24 Jan 12:40:29 ntpd[17283]: ntpd: time slew -0.001668 s 2024-01-24T12:40:29.261 INFO:teuthology.orchestra.run.smithi124.stdout:ntpd: time slew -0.001668s 2024-01-24T12:40:29.262 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-24T12:40:29.262 INFO:teuthology.orchestra.run.smithi124.stderr:24 Jan 12:40:29 ntpd[17283]: can't open /var/log/ntpstats/loopstats.20240124: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:29.295 INFO:teuthology.orchestra.run.smithi195.stdout:24 Jan 12:40:29 ntpd[16836]: ntpd: time slew -0.000492 s 2024-01-24T12:40:29.295 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew -0.000492s 2024-01-24T12:40:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-24T12:40:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:24 Jan 12:40:29 ntpd[16836]: can't open /var/log/ntpstats/loopstats.20240124: Permission denied 2024-01-24T12:40:29.384 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T12:40:29.385 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-24T12:40:29.385 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.385 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.385 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.385 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.572 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T12:40:29.573 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2024-01-24T12:40:29.573 INFO:teuthology.orchestra.run.smithi124.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.573 INFO:teuthology.orchestra.run.smithi124.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.573 INFO:teuthology.orchestra.run.smithi124.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:29.573 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:30.257 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: can't open /var/log/ntpstats/rawstats.20240124: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: can't open /var/log/ntpstats/peerstats.20240124: Permission denied 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stdout:24 Jan 12:40:30 ntpd[17362]: ntpd: time slew -0.004755 s 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.004755s 2024-01-24T12:40:30.258 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-24T12:40:30.259 INFO:teuthology.orchestra.run.smithi027.stderr:24 Jan 12:40:30 ntpd[17362]: can't open /var/log/ntpstats/loopstats.20240124: Permission denied 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:30.356 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-24T12:40:30.357 INFO:teuthology.run_tasks:Running task install... 2024-01-24T12:40:30.365 DEBUG:teuthology.task.install:project ceph 2024-01-24T12:40:30.365 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}} 2024-01-24T12:40:30.366 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'} 2024-01-24T12:40:30.366 INFO:teuthology.task.install:Using flavor: default 2024-01-24T12:40:30.371 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-24T12:40:30.371 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-24T12:40:30.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2024-01-24T12:40:30.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-key list | grep Ceph 2024-01-24T12:40:30.373 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2024-01-24T12:40:30.434 INFO:teuthology.orchestra.run.smithi124.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-24T12:40:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-24T12:40:30.461 INFO:teuthology.orchestra.run.smithi124.stdout:uid [ unknown] Ceph.com (release key) 2024-01-24T12:40:30.461 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-24T12:40:30.462 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-24T12:40:30.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:40:30.468 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-24T12:40:30.477 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-24T12:40:30.498 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-24T12:40:30.498 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2024-01-24T12:40:30.499 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-24T12:40:30.499 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-24T12:40:30.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:40:30.528 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-24T12:40:30.528 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2024-01-24T12:40:30.529 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-24T12:40:30.529 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-24T12:40:30.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:40:30.626 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default/ 2024-01-24T12:40:30.626 INFO:teuthology.task.install.deb:Package version is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:30.742 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default/ 2024-01-24T12:40:30.742 INFO:teuthology.task.install.deb:Package version is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:30.746 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:40:30.746 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-24T12:40:30.748 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default/ 2024-01-24T12:40:30.748 INFO:teuthology.task.install.deb:Package version is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:30.763 DEBUG:teuthology.orchestra.run.smithi124:> sudo apt-get update 2024-01-24T12:40:30.858 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:40:30.858 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-24T12:40:30.873 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-01-24T12:40:30.916 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:40:30.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-24T12:40:30.934 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-24T12:40:30.935 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-24T12:40:30.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-01-24T12:40:30.947 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-24T12:40:30.968 INFO:teuthology.orchestra.run.smithi124.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-24T12:40:31.053 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy InRelease 2024-01-24T12:40:31.054 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-24T12:40:31.054 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-24T12:40:31.066 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-24T12:40:31.087 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-24T12:40:31.090 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-24T12:40:31.099 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy InRelease 2024-01-24T12:40:31.120 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-24T12:40:31.127 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-24T12:40:31.127 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-24T12:40:31.127 INFO:teuthology.orchestra.run.smithi124.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-24T12:40:31.136 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-24T12:40:31.141 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-24T12:40:31.156 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-24T12:40:31.165 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-01-24T12:40:31.239 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy InRelease 2024-01-24T12:40:31.239 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-01-24T12:40:31.254 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-01-24T12:40:31.259 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-24T12:40:31.266 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-01-24T12:40:31.282 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-24T12:40:31.303 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-01-24T12:40:31.335 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-01-24T12:40:31.337 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 28.5 kB in 0s (73.0 kB/s) 2024-01-24T12:40:31.428 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.5 kB in 0s (76.5 kB/s) 2024-01-24T12:40:31.713 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 28.5 kB in 1s (51.5 kB/s) 2024-01-24T12:40:32.260 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-24T12:40:32.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-341-g4e3182a6-1jammy cephadm=18.2.1-341-g4e3182a6-1jammy ceph-mds=18.2.1-341-g4e3182a6-1jammy ceph-mgr=18.2.1-341-g4e3182a6-1jammy ceph-common=18.2.1-341-g4e3182a6-1jammy ceph-fuse=18.2.1-341-g4e3182a6-1jammy ceph-test=18.2.1-341-g4e3182a6-1jammy ceph-volume=18.2.1-341-g4e3182a6-1jammy radosgw=18.2.1-341-g4e3182a6-1jammy python3-rados=18.2.1-341-g4e3182a6-1jammy python3-rgw=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy python3-rbd=18.2.1-341-g4e3182a6-1jammy libcephfs2=18.2.1-341-g4e3182a6-1jammy libcephfs-dev=18.2.1-341-g4e3182a6-1jammy librados2=18.2.1-341-g4e3182a6-1jammy librbd1=18.2.1-341-g4e3182a6-1jammy rbd-fuse=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy cephfs-shell=18.2.1-341-g4e3182a6-1jammy cephfs-top=18.2.1-341-g4e3182a6-1jammy cephfs-mirror=18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:32.325 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-24T12:40:32.326 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-24T12:40:32.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-341-g4e3182a6-1jammy cephadm=18.2.1-341-g4e3182a6-1jammy ceph-mds=18.2.1-341-g4e3182a6-1jammy ceph-mgr=18.2.1-341-g4e3182a6-1jammy ceph-common=18.2.1-341-g4e3182a6-1jammy ceph-fuse=18.2.1-341-g4e3182a6-1jammy ceph-test=18.2.1-341-g4e3182a6-1jammy ceph-volume=18.2.1-341-g4e3182a6-1jammy radosgw=18.2.1-341-g4e3182a6-1jammy python3-rados=18.2.1-341-g4e3182a6-1jammy python3-rgw=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy python3-rbd=18.2.1-341-g4e3182a6-1jammy libcephfs2=18.2.1-341-g4e3182a6-1jammy libcephfs-dev=18.2.1-341-g4e3182a6-1jammy librados2=18.2.1-341-g4e3182a6-1jammy librbd1=18.2.1-341-g4e3182a6-1jammy rbd-fuse=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy cephfs-shell=18.2.1-341-g4e3182a6-1jammy cephfs-top=18.2.1-341-g4e3182a6-1jammy cephfs-mirror=18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:32.404 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-24T12:40:32.500 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2024-01-24T12:40:32.501 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2024-01-24T12:40:32.597 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-01-24T12:40:32.597 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-01-24T12:40:32.640 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-24T12:40:32.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-341-g4e3182a6-1jammy cephadm=18.2.1-341-g4e3182a6-1jammy ceph-mds=18.2.1-341-g4e3182a6-1jammy ceph-mgr=18.2.1-341-g4e3182a6-1jammy ceph-common=18.2.1-341-g4e3182a6-1jammy ceph-fuse=18.2.1-341-g4e3182a6-1jammy ceph-test=18.2.1-341-g4e3182a6-1jammy ceph-volume=18.2.1-341-g4e3182a6-1jammy radosgw=18.2.1-341-g4e3182a6-1jammy python3-rados=18.2.1-341-g4e3182a6-1jammy python3-rgw=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy python3-rbd=18.2.1-341-g4e3182a6-1jammy libcephfs2=18.2.1-341-g4e3182a6-1jammy libcephfs-dev=18.2.1-341-g4e3182a6-1jammy librados2=18.2.1-341-g4e3182a6-1jammy librbd1=18.2.1-341-g4e3182a6-1jammy rbd-fuse=18.2.1-341-g4e3182a6-1jammy python3-cephfs=18.2.1-341-g4e3182a6-1jammy cephfs-shell=18.2.1-341-g4e3182a6-1jammy cephfs-top=18.2.1-341-g4e3182a6-1jammy cephfs-mirror=18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:40:32.658 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:40:32.658 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:40:32.658 INFO:teuthology.orchestra.run.smithi124.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:40:32.659 INFO:teuthology.orchestra.run.smithi124.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:40:32.659 INFO:teuthology.orchestra.run.smithi124.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-24T12:40:32.659 INFO:teuthology.orchestra.run.smithi124.stdout: python2.7-minimal 2024-01-24T12:40:32.659 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:40:32.660 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2024-01-24T12:40:32.660 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-24T12:40:32.660 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-24T12:40:32.660 INFO:teuthology.orchestra.run.smithi124.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:32.663 INFO:teuthology.orchestra.run.smithi124.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-24T12:40:32.664 INFO:teuthology.orchestra.run.smithi124.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: qttranslations5-l10n socat xmlstarlet 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-01-24T12:40:32.665 INFO:teuthology.orchestra.run.smithi124.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-01-24T12:40:32.666 INFO:teuthology.orchestra.run.smithi124.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-01-24T12:40:32.666 INFO:teuthology.orchestra.run.smithi124.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-01-24T12:40:32.666 INFO:teuthology.orchestra.run.smithi124.stdout: python3-watchdog 2024-01-24T12:40:32.666 INFO:teuthology.orchestra.run.smithi124.stdout:Recommended packages: 2024-01-24T12:40:32.666 INFO:teuthology.orchestra.run.smithi124.stdout: btrfs-tools 2024-01-24T12:40:32.728 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-24T12:40:32.763 INFO:teuthology.orchestra.run.smithi124.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-01-24T12:40:32.764 INFO:teuthology.orchestra.run.smithi124.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-01-24T12:40:32.764 INFO:teuthology.orchestra.run.smithi124.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-24T12:40:32.764 INFO:teuthology.orchestra.run.smithi124.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-24T12:40:32.764 INFO:teuthology.orchestra.run.smithi124.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-24T12:40:32.765 INFO:teuthology.orchestra.run.smithi124.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-24T12:40:32.766 INFO:teuthology.orchestra.run.smithi124.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-24T12:40:32.766 INFO:teuthology.orchestra.run.smithi124.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-24T12:40:32.766 INFO:teuthology.orchestra.run.smithi124.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-24T12:40:32.766 INFO:teuthology.orchestra.run.smithi124.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-24T12:40:32.766 INFO:teuthology.orchestra.run.smithi124.stdout: socat xmlstarlet 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout: python2.7-minimal 2024-01-24T12:40:32.779 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-24T12:40:32.781 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-24T12:40:32.782 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n socat xmlstarlet 2024-01-24T12:40:32.783 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: python3-watchdog 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-01-24T12:40:32.784 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-24T12:40:32.890 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:32.891 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-24T12:40:32.891 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-24T12:40:32.892 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-24T12:40:32.893 INFO:teuthology.orchestra.run.smithi027.stdout: socat xmlstarlet 2024-01-24T12:40:32.899 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-24T12:40:32.899 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-24T12:40:32.949 INFO:teuthology.orchestra.run.smithi124.stdout:0 upgraded, 115 newly installed, 0 to remove and 269 not upgraded. 2024-01-24T12:40:32.950 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 181 MB of archives. 2024-01-24T12:40:32.950 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 812 MB of additional disk space will be used. 2024-01-24T12:40:32.950 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-24T12:40:32.953 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-341-g4e3182a6-1jammy [3,416 kB] 2024-01-24T12:40:32.957 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 115 newly installed, 0 to remove and 269 not upgraded. 2024-01-24T12:40:32.957 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 181 MB of archives. 2024-01-24T12:40:32.957 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 812 MB of additional disk space will be used. 2024-01-24T12:40:32.957 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-24T12:40:32.978 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-24T12:40:32.990 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-24T12:40:33.032 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-24T12:40:33.033 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-341-g4e3182a6-1jammy [3,416 kB] 2024-01-24T12:40:33.038 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-01-24T12:40:33.049 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T12:40:33.053 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-24T12:40:33.055 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-24T12:40:33.056 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n socat xmlstarlet 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-01-24T12:40:33.057 INFO:teuthology.orchestra.run.smithi195.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-01-24T12:40:33.058 INFO:teuthology.orchestra.run.smithi195.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-01-24T12:40:33.058 INFO:teuthology.orchestra.run.smithi195.stdout: python3-watchdog 2024-01-24T12:40:33.058 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-01-24T12:40:33.058 INFO:teuthology.orchestra.run.smithi195.stdout: btrfs-tools 2024-01-24T12:40:33.069 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-24T12:40:33.071 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-24T12:40:33.077 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-24T12:40:33.083 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-24T12:40:33.139 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-24T12:40:33.143 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-24T12:40:33.155 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-24T12:40:33.159 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-24T12:40:33.159 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-24T12:40:33.167 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-24T12:40:33.168 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-24T12:40:33.168 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-24T12:40:33.170 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-24T12:40:33.170 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-24T12:40:33.173 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-341-g4e3182a6-1jammy [3,103 kB] 2024-01-24T12:40:33.184 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-24T12:40:33.184 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-24T12:40:33.185 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-24T12:40:33.185 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-24T12:40:33.198 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-24T12:40:33.198 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-24T12:40:33.198 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-24T12:40:33.198 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-24T12:40:33.200 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-24T12:40:33.201 INFO:teuthology.orchestra.run.smithi195.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-24T12:40:33.202 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-24T12:40:33.202 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-24T12:40:33.202 INFO:teuthology.orchestra.run.smithi195.stdout: socat xmlstarlet 2024-01-24T12:40:33.204 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-24T12:40:33.207 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-24T12:40:33.208 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-24T12:40:33.208 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-24T12:40:33.209 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-24T12:40:33.210 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-24T12:40:33.225 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-24T12:40:33.228 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-24T12:40:33.230 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-24T12:40:33.231 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-24T12:40:33.246 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-24T12:40:33.259 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-24T12:40:33.273 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-01-24T12:40:33.283 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-24T12:40:33.285 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-24T12:40:33.288 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-24T12:40:33.295 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-24T12:40:33.297 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-24T12:40:33.298 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-341-g4e3182a6-1jammy [671 kB] 2024-01-24T12:40:33.299 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-24T12:40:33.303 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-24T12:40:33.306 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-24T12:40:33.310 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-24T12:40:33.315 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-24T12:40:33.325 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-24T12:40:33.326 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-341-g4e3182a6-1jammy [356 kB] 2024-01-24T12:40:33.327 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-24T12:40:33.340 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-341-g4e3182a6-1jammy [32.8 kB] 2024-01-24T12:40:33.341 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-341-g4e3182a6-1jammy [180 kB] 2024-01-24T12:40:33.347 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-341-g4e3182a6-1jammy [61.5 kB] 2024-01-24T12:40:33.365 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-341-g4e3182a6-1jammy [330 kB] 2024-01-24T12:40:33.384 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-24T12:40:33.385 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-24T12:40:33.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-24T12:40:33.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-24T12:40:33.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-24T12:40:33.388 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-24T12:40:33.388 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-24T12:40:33.390 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-24T12:40:33.394 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 115 newly installed, 0 to remove and 269 not upgraded. 2024-01-24T12:40:33.394 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 181 MB of archives. 2024-01-24T12:40:33.394 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 812 MB of additional disk space will be used. 2024-01-24T12:40:33.394 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-24T12:40:33.395 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-24T12:40:33.397 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-24T12:40:33.402 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-24T12:40:33.404 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-341-g4e3182a6-1jammy [5,882 kB] 2024-01-24T12:40:33.406 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-24T12:40:33.406 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-341-g4e3182a6-1jammy [3,416 kB] 2024-01-24T12:40:33.419 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-24T12:40:33.440 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-24T12:40:33.442 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-24T12:40:33.443 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-24T12:40:33.447 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-24T12:40:33.461 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-24T12:40:33.461 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-24T12:40:33.462 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-24T12:40:33.462 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-24T12:40:33.474 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-24T12:40:33.475 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-24T12:40:33.475 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-24T12:40:33.476 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-24T12:40:33.484 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-24T12:40:33.488 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-24T12:40:33.489 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-24T12:40:33.491 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-24T12:40:33.492 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-24T12:40:33.504 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-24T12:40:33.509 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-341-g4e3182a6-1jammy [3,103 kB] 2024-01-24T12:40:33.510 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-24T12:40:33.510 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-24T12:40:33.515 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-24T12:40:33.517 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-24T12:40:33.522 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-24T12:40:33.525 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-24T12:40:33.527 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-24T12:40:33.534 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-24T12:40:33.534 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-24T12:40:33.535 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-24T12:40:33.614 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-24T12:40:33.623 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-24T12:40:33.649 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-24T12:40:33.660 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-341-g4e3182a6-1jammy [112 kB] 2024-01-24T12:40:33.663 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-341-g4e3182a6-1jammy [442 kB] 2024-01-24T12:40:33.679 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-341-g4e3182a6-1jammy [22.0 MB] 2024-01-24T12:40:33.723 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-01-24T12:40:33.761 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-24T12:40:33.820 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-24T12:40:33.835 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-24T12:40:33.847 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-24T12:40:33.892 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-24T12:40:34.021 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-341-g4e3182a6-1jammy [671 kB] 2024-01-24T12:40:34.023 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-24T12:40:34.056 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-24T12:40:34.065 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-24T12:40:34.077 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-341-g4e3182a6-1jammy [356 kB] 2024-01-24T12:40:34.091 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-24T12:40:34.118 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-341-g4e3182a6-1jammy [32.8 kB] 2024-01-24T12:40:34.120 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-341-g4e3182a6-1jammy [180 kB] 2024-01-24T12:40:34.162 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-341-g4e3182a6-1jammy [61.5 kB] 2024-01-24T12:40:34.164 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-341-g4e3182a6-1jammy [330 kB] 2024-01-24T12:40:34.212 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-341-g4e3182a6-1jammy [5,882 kB] 2024-01-24T12:40:34.263 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-24T12:40:34.396 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-24T12:40:34.403 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-24T12:40:34.404 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-24T12:40:34.416 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-24T12:40:34.418 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-24T12:40:34.419 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-24T12:40:34.421 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-24T12:40:34.423 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-24T12:40:34.424 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-24T12:40:34.455 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-24T12:40:34.592 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-24T12:40:34.741 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-341-g4e3182a6-1jammy [6,836 kB] 2024-01-24T12:40:34.871 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-24T12:40:34.878 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-24T12:40:34.879 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-24T12:40:34.891 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-24T12:40:34.892 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-24T12:40:34.893 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-24T12:40:34.895 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-24T12:40:34.897 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-24T12:40:34.898 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-24T12:40:34.965 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-341-g4e3182a6-1jammy [112 kB] 2024-01-24T12:40:34.998 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-341-g4e3182a6-1jammy [442 kB] 2024-01-24T12:40:35.014 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-341-g4e3182a6-1jammy [238 kB] 2024-01-24T12:40:35.020 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-341-g4e3182a6-1jammy [129 kB] 2024-01-24T12:40:35.029 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-341-g4e3182a6-1jammy [1,483 kB] 2024-01-24T12:40:35.031 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-24T12:40:35.042 INFO:teuthology.orchestra.run.smithi124.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-24T12:40:35.047 INFO:teuthology.orchestra.run.smithi124.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-24T12:40:35.051 INFO:teuthology.orchestra.run.smithi124.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-24T12:40:35.056 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-341-g4e3182a6-1jammy [22.0 MB] 2024-01-24T12:40:35.063 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-24T12:40:35.069 INFO:teuthology.orchestra.run.smithi124.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-24T12:40:35.072 INFO:teuthology.orchestra.run.smithi124.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-24T12:40:35.074 INFO:teuthology.orchestra.run.smithi124.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-24T12:40:35.095 INFO:teuthology.orchestra.run.smithi124.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-341-g4e3182a6-1jammy [9,874 kB] 2024-01-24T12:40:35.116 INFO:teuthology.orchestra.run.smithi124.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-24T12:40:35.130 INFO:teuthology.orchestra.run.smithi124.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-24T12:40:35.135 INFO:teuthology.orchestra.run.smithi124.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-24T12:40:35.388 INFO:teuthology.orchestra.run.smithi124.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-24T12:40:35.471 INFO:teuthology.orchestra.run.smithi124.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-24T12:40:35.513 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-24T12:40:35.524 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-24T12:40:35.531 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-24T12:40:35.533 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-24T12:40:35.551 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-24T12:40:35.554 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-24T12:40:35.556 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-24T12:40:35.562 INFO:teuthology.orchestra.run.smithi124.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-341-g4e3182a6-1jammy [31.5 MB] 2024-01-24T12:40:35.574 INFO:teuthology.orchestra.run.smithi124.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-24T12:40:35.598 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-24T12:40:35.612 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-24T12:40:35.617 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-24T12:40:35.643 INFO:teuthology.orchestra.run.smithi124.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-24T12:40:35.650 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-341-g4e3182a6-1jammy [3,103 kB] 2024-01-24T12:40:35.759 INFO:teuthology.orchestra.run.smithi124.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-24T12:40:35.848 INFO:teuthology.orchestra.run.smithi124.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-24T12:40:35.866 INFO:teuthology.orchestra.run.smithi124.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-24T12:40:35.871 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-24T12:40:35.896 INFO:teuthology.orchestra.run.smithi124.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-24T12:40:35.908 INFO:teuthology.orchestra.run.smithi124.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-24T12:40:35.945 INFO:teuthology.orchestra.run.smithi124.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-24T12:40:35.953 INFO:teuthology.orchestra.run.smithi124.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-24T12:40:35.954 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-24T12:40:36.051 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-24T12:40:36.119 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-24T12:40:36.144 INFO:teuthology.orchestra.run.smithi124.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-24T12:40:36.224 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-24T12:40:36.306 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-24T12:40:36.325 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-24T12:40:36.355 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-24T12:40:36.367 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-24T12:40:36.402 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-24T12:40:36.410 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-24T12:40:36.602 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-24T12:40:36.919 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-341-g4e3182a6-1jammy [671 kB] 2024-01-24T12:40:36.957 INFO:teuthology.orchestra.run.smithi124.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-24T12:40:36.959 INFO:teuthology.orchestra.run.smithi124.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-24T12:40:36.962 INFO:teuthology.orchestra.run.smithi124.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-24T12:40:36.963 INFO:teuthology.orchestra.run.smithi124.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-24T12:40:36.964 INFO:teuthology.orchestra.run.smithi124.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-24T12:40:36.967 INFO:teuthology.orchestra.run.smithi124.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-24T12:40:36.968 INFO:teuthology.orchestra.run.smithi124.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-24T12:40:36.968 INFO:teuthology.orchestra.run.smithi124.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-24T12:40:36.973 INFO:teuthology.orchestra.run.smithi124.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-24T12:40:37.034 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-341-g4e3182a6-1jammy [356 kB] 2024-01-24T12:40:37.038 INFO:teuthology.orchestra.run.smithi124.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-24T12:40:37.095 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-341-g4e3182a6-1jammy [32.8 kB] 2024-01-24T12:40:37.113 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-341-g4e3182a6-1jammy [180 kB] 2024-01-24T12:40:37.140 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-341-g4e3182a6-1jammy [61.5 kB] 2024-01-24T12:40:37.158 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-341-g4e3182a6-1jammy [330 kB] 2024-01-24T12:40:37.172 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-341-g4e3182a6-1jammy [6,836 kB] 2024-01-24T12:40:37.204 INFO:teuthology.orchestra.run.smithi124.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-24T12:40:37.261 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-341-g4e3182a6-1jammy [5,882 kB] 2024-01-24T12:40:37.433 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-24T12:40:37.434 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-24T12:40:37.435 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-24T12:40:37.436 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-24T12:40:37.436 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-24T12:40:37.438 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-24T12:40:37.438 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-24T12:40:37.439 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-24T12:40:37.441 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-24T12:40:37.514 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-24T12:40:37.673 INFO:teuthology.orchestra.run.smithi124.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-341-g4e3182a6-1jammy [14.1 kB] 2024-01-24T12:40:37.673 INFO:teuthology.orchestra.run.smithi124.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-341-g4e3182a6-1jammy [824 kB] 2024-01-24T12:40:37.680 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-24T12:40:37.689 INFO:teuthology.orchestra.run.smithi124.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-341-g4e3182a6-1jammy [2,175 kB] 2024-01-24T12:40:37.728 INFO:teuthology.orchestra.run.smithi124.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-341-g4e3182a6-1jammy [235 kB] 2024-01-24T12:40:37.732 INFO:teuthology.orchestra.run.smithi124.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-341-g4e3182a6-1jammy [138 kB] 2024-01-24T12:40:37.734 INFO:teuthology.orchestra.run.smithi124.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-341-g4e3182a6-1jammy [1,901 kB] 2024-01-24T12:40:37.776 INFO:teuthology.orchestra.run.smithi124.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-341-g4e3182a6-1jammy [8,625 kB] 2024-01-24T12:40:37.910 INFO:teuthology.orchestra.run.smithi124.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-24T12:40:37.915 INFO:teuthology.orchestra.run.smithi124.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-24T12:40:37.916 INFO:teuthology.orchestra.run.smithi124.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-24T12:40:37.955 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-341-g4e3182a6-1jammy [238 kB] 2024-01-24T12:40:37.960 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-341-g4e3182a6-1jammy [129 kB] 2024-01-24T12:40:37.967 INFO:teuthology.orchestra.run.smithi124.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-24T12:40:37.992 INFO:teuthology.orchestra.run.smithi124.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-24T12:40:37.993 INFO:teuthology.orchestra.run.smithi124.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-24T12:40:37.995 INFO:teuthology.orchestra.run.smithi124.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-24T12:40:37.996 INFO:teuthology.orchestra.run.smithi124.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-24T12:40:37.997 INFO:teuthology.orchestra.run.smithi124.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-24T12:40:38.015 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-341-g4e3182a6-1jammy [1,483 kB] 2024-01-24T12:40:38.162 INFO:teuthology.orchestra.run.smithi124.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-24T12:40:38.192 INFO:teuthology.orchestra.run.smithi124.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-341-g4e3182a6-1jammy [14.3 kB] 2024-01-24T12:40:38.193 INFO:teuthology.orchestra.run.smithi124.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-341-g4e3182a6-1jammy [46.4 MB] 2024-01-24T12:40:38.236 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-341-g4e3182a6-1jammy [9,874 kB] 2024-01-24T12:40:38.290 INFO:teuthology.orchestra.run.smithi124.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-24T12:40:38.401 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-24T12:40:38.407 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-24T12:40:38.407 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-24T12:40:38.460 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-24T12:40:38.460 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-24T12:40:38.484 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-24T12:40:38.485 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-24T12:40:38.485 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-24T12:40:38.486 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-24T12:40:38.487 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-24T12:40:38.595 INFO:teuthology.orchestra.run.smithi124.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-24T12:40:38.640 INFO:teuthology.orchestra.run.smithi124.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-24T12:40:38.652 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-24T12:40:38.664 INFO:teuthology.orchestra.run.smithi124.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-24T12:40:38.673 INFO:teuthology.orchestra.run.smithi124.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-24T12:40:38.719 INFO:teuthology.orchestra.run.smithi124.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-24T12:40:38.744 INFO:teuthology.orchestra.run.smithi124.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-24T12:40:38.746 INFO:teuthology.orchestra.run.smithi124.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-24T12:40:38.780 INFO:teuthology.orchestra.run.smithi124.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-24T12:40:38.798 INFO:teuthology.orchestra.run.smithi124.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-24T12:40:38.965 INFO:teuthology.orchestra.run.smithi124.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-24T12:40:39.165 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-24T12:40:39.194 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-24T12:40:39.217 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-24T12:40:39.225 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-24T12:40:39.304 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-24T12:40:39.336 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-24T12:40:39.337 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-24T12:40:39.366 INFO:teuthology.orchestra.run.smithi124.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-24T12:40:39.373 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-24T12:40:39.398 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-24T12:40:39.402 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-24T12:40:39.562 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-341-g4e3182a6-1jammy [31.5 MB] 2024-01-24T12:40:39.577 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-24T12:40:39.586 INFO:teuthology.orchestra.run.smithi124.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-24T12:40:39.591 INFO:teuthology.orchestra.run.smithi124.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-24T12:40:39.600 INFO:teuthology.orchestra.run.smithi124.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-24T12:40:40.189 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-24T12:40:40.191 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-24T12:40:40.195 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-24T12:40:40.334 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-341-g4e3182a6-1jammy [112 kB] 2024-01-24T12:40:40.352 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-341-g4e3182a6-1jammy [442 kB] 2024-01-24T12:40:40.416 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-341-g4e3182a6-1jammy [22.0 MB] 2024-01-24T12:40:41.048 INFO:teuthology.orchestra.run.smithi124.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-341-g4e3182a6-1jammy [121 kB] 2024-01-24T12:40:41.084 INFO:teuthology.orchestra.run.smithi124.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-341-g4e3182a6-1jammy [228 kB] 2024-01-24T12:40:41.170 INFO:teuthology.orchestra.run.smithi124.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-341-g4e3182a6-1jammy [34.0 kB] 2024-01-24T12:40:41.189 INFO:teuthology.orchestra.run.smithi124.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-341-g4e3182a6-1jammy [23.3 kB] 2024-01-24T12:40:41.200 INFO:teuthology.orchestra.run.smithi124.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-341-g4e3182a6-1jammy [38.3 kB] 2024-01-24T12:40:41.201 INFO:teuthology.orchestra.run.smithi124.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-341-g4e3182a6-1jammy [11.6 MB] 2024-01-24T12:40:41.753 INFO:teuthology.orchestra.run.smithi124.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-341-g4e3182a6-1jammy [92.9 kB] 2024-01-24T12:40:42.054 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-341-g4e3182a6-1jammy [14.1 kB] 2024-01-24T12:40:42.055 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-341-g4e3182a6-1jammy [824 kB] 2024-01-24T12:40:42.071 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-341-g4e3182a6-1jammy [2,175 kB] 2024-01-24T12:40:42.159 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-341-g4e3182a6-1jammy [235 kB] 2024-01-24T12:40:42.164 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-341-g4e3182a6-1jammy [138 kB] 2024-01-24T12:40:42.167 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-341-g4e3182a6-1jammy [1,901 kB] 2024-01-24T12:40:42.250 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-341-g4e3182a6-1jammy [8,625 kB] 2024-01-24T12:40:42.307 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 181 MB in 9s (20.1 MB/s) 2024-01-24T12:40:42.434 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-24T12:40:42.507 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-01-24T12:40:42.511 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-24T12:40:42.550 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-24T12:40:42.635 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-341-g4e3182a6-1jammy [14.3 kB] 2024-01-24T12:40:42.635 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-341-g4e3182a6-1jammy [46.4 MB] 2024-01-24T12:40:42.802 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-24T12:40:42.814 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-24T12:40:42.844 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:40:43.113 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cmd2. 2024-01-24T12:40:43.125 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-24T12:40:43.164 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-24T12:40:43.449 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libfmt8:amd64. 2024-01-24T12:40:43.470 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-01-24T12:40:43.559 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:40:43.692 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-341-g4e3182a6-1jammy [6,836 kB] 2024-01-24T12:40:43.903 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-24T12:40:43.923 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-24T12:40:43.961 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:40:44.436 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-341-g4e3182a6-1jammy [238 kB] 2024-01-24T12:40:44.460 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-341-g4e3182a6-1jammy [129 kB] 2024-01-24T12:40:44.472 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-341-g4e3182a6-1jammy [1,483 kB] 2024-01-24T12:40:44.560 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-24T12:40:44.580 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-24T12:40:44.623 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:40:44.628 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-341-g4e3182a6-1jammy [9,874 kB] 2024-01-24T12:40:44.885 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-24T12:40:44.905 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:40:44.934 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:40:45.007 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-341-g4e3182a6-1jammy [121 kB] 2024-01-24T12:40:45.009 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-341-g4e3182a6-1jammy [228 kB] 2024-01-24T12:40:45.014 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-341-g4e3182a6-1jammy [34.0 kB] 2024-01-24T12:40:45.015 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-341-g4e3182a6-1jammy [23.3 kB] 2024-01-24T12:40:45.016 INFO:teuthology.orchestra.run.smithi027.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-341-g4e3182a6-1jammy [38.3 kB] 2024-01-24T12:40:45.018 INFO:teuthology.orchestra.run.smithi027.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-341-g4e3182a6-1jammy [11.6 MB] 2024-01-24T12:40:45.388 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-24T12:40:45.408 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:45.454 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:45.559 INFO:teuthology.orchestra.run.smithi027.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-341-g4e3182a6-1jammy [92.9 kB] 2024-01-24T12:40:45.566 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-341-g4e3182a6-1jammy [31.5 MB] 2024-01-24T12:40:45.833 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-24T12:40:45.853 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:45.883 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:46.145 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 181 MB in 13s (14.3 MB/s) 2024-01-24T12:40:46.244 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-24T12:40:46.265 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:46.296 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-24T12:40:46.303 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:46.382 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-01-24T12:40:46.387 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-24T12:40:46.419 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-24T12:40:46.656 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-24T12:40:46.672 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-24T12:40:46.676 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-24T12:40:46.693 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-24T12:40:46.714 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:40:46.730 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:40:47.000 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librados2. 2024-01-24T12:40:47.020 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../011-librados2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:47.042 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cmd2. 2024-01-24T12:40:47.050 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:47.062 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-24T12:40:47.100 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-24T12:40:47.403 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libfmt8:amd64. 2024-01-24T12:40:47.424 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-01-24T12:40:47.487 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:40:47.503 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librbd1. 2024-01-24T12:40:47.523 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../012-librbd1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:47.561 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:47.729 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-341-g4e3182a6-1jammy [14.1 kB] 2024-01-24T12:40:47.729 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-341-g4e3182a6-1jammy [824 kB] 2024-01-24T12:40:47.771 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-341-g4e3182a6-1jammy [2,175 kB] 2024-01-24T12:40:47.806 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-24T12:40:47.827 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-24T12:40:47.864 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:40:47.903 INFO:teuthology.orchestra.run.smithi195.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-341-g4e3182a6-1jammy [235 kB] 2024-01-24T12:40:47.915 INFO:teuthology.orchestra.run.smithi195.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-341-g4e3182a6-1jammy [138 kB] 2024-01-24T12:40:47.922 INFO:teuthology.orchestra.run.smithi195.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-341-g4e3182a6-1jammy [1,901 kB] 2024-01-24T12:40:47.998 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs2. 2024-01-24T12:40:48.018 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:48.038 INFO:teuthology.orchestra.run.smithi195.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-341-g4e3182a6-1jammy [8,625 kB] 2024-01-24T12:40:48.056 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:48.209 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-24T12:40:48.230 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-24T12:40:48.267 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:40:48.341 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rados. 2024-01-24T12:40:48.362 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../014-python3-rados_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:48.400 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:48.542 INFO:teuthology.orchestra.run.smithi195.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-341-g4e3182a6-1jammy [14.3 kB] 2024-01-24T12:40:48.542 INFO:teuthology.orchestra.run.smithi195.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-341-g4e3182a6-1jammy [46.4 MB] 2024-01-24T12:40:48.711 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-24T12:40:48.731 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:48.751 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-24T12:40:48.769 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:48.772 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:40:48.937 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:40:49.022 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cephfs. 2024-01-24T12:40:49.042 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:49.080 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:49.332 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-24T12:40:49.353 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:49.399 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:49.458 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-24T12:40:49.478 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:49.516 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:49.810 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-24T12:40:49.831 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:49.868 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:49.936 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-prettytable. 2024-01-24T12:40:49.957 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-01-24T12:40:49.995 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-24T12:40:50.197 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-24T12:40:50.218 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:50.239 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rbd. 2024-01-24T12:40:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:50.259 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:50.297 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:50.541 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-24T12:40:50.551 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-24T12:40:50.591 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:40:50.650 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-24T12:40:50.670 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-24T12:40:50.709 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:40:50.915 INFO:teuthology.orchestra.run.smithi195.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-341-g4e3182a6-1jammy [121 kB] 2024-01-24T12:40:50.916 INFO:teuthology.orchestra.run.smithi195.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-341-g4e3182a6-1jammy [228 kB] 2024-01-24T12:40:50.918 INFO:teuthology.orchestra.run.smithi195.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-341-g4e3182a6-1jammy [34.0 kB] 2024-01-24T12:40:50.919 INFO:teuthology.orchestra.run.smithi195.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-341-g4e3182a6-1jammy [23.3 kB] 2024-01-24T12:40:50.919 INFO:teuthology.orchestra.run.smithi195.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-341-g4e3182a6-1jammy [38.3 kB] 2024-01-24T12:40:50.920 INFO:teuthology.orchestra.run.smithi195.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-341-g4e3182a6-1jammy [11.6 MB] 2024-01-24T12:40:50.927 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librados2. 2024-01-24T12:40:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-librados2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:50.985 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:51.053 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package librgw2. 2024-01-24T12:40:51.073 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../021-librgw2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:51.111 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:51.438 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librbd1. 2024-01-24T12:40:51.451 INFO:teuthology.orchestra.run.smithi195.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-341-g4e3182a6-1jammy [92.9 kB] 2024-01-24T12:40:51.459 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-librbd1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:51.496 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:51.605 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rgw. 2024-01-24T12:40:51.617 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:51.647 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:51.916 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2024-01-24T12:40:51.928 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:51.975 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-24T12:40:51.991 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:51.995 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-24T12:40:52.019 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 181 MB in 18s (9,912 kB/s) 2024-01-24T12:40:52.033 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:40:52.141 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-24T12:40:52.207 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-24T12:40:52.211 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-24T12:40:52.256 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-24T12:40:52.260 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2024-01-24T12:40:52.281 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-python3-rados_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:52.318 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:52.347 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libradosstriper1. 2024-01-24T12:40:52.365 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:52.403 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:52.576 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-24T12:40:52.589 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-24T12:40:52.634 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:40:52.646 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-24T12:40:52.667 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:52.704 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:52.856 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-common. 2024-01-24T12:40:52.876 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../025-ceph-common_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:52.914 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:52.957 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2024-01-24T12:40:52.969 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:52.970 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cmd2. 2024-01-24T12:40:52.984 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-24T12:40:53.007 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:53.028 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-24T12:40:53.301 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-24T12:40:53.322 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:53.359 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:53.365 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfmt8:amd64. 2024-01-24T12:40:53.379 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-01-24T12:40:53.465 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:40:53.654 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2024-01-24T12:40:53.675 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-01-24T12:40:53.712 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-24T12:40:53.793 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-24T12:40:53.808 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-24T12:40:53.843 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:40:54.098 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2024-01-24T12:40:54.119 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:54.173 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:54.187 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-base. 2024-01-24T12:40:54.188 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-24T12:40:54.203 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-24T12:40:54.207 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../026-ceph-base_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:54.238 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:40:54.255 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:54.476 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-24T12:40:54.497 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-24T12:40:54.526 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:40:54.541 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-24T12:40:54.556 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:40:54.599 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:40:54.829 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2024-01-24T12:40:54.850 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-librgw2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:55.053 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-24T12:40:55.068 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:55.119 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:55.208 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-24T12:40:55.228 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-24T12:40:55.266 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:40:55.415 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2024-01-24T12:40:55.427 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:55.464 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:55.514 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-24T12:40:55.529 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:55.564 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:55.577 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cheroot. 2024-01-24T12:40:55.598 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-24T12:40:55.636 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:40:55.834 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-24T12:40:55.855 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-24T12:40:55.892 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:40:55.900 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-24T12:40:55.916 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-24T12:40:55.964 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-24T12:40:55.976 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:40:55.984 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-24T12:40:56.013 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:40:56.170 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2024-01-24T12:40:56.191 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:56.220 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:56.308 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-24T12:40:56.312 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-24T12:40:56.327 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-24T12:40:56.328 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-24T12:40:56.366 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:40:56.370 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:40:56.665 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2024-01-24T12:40:56.678 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-24T12:40:56.686 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-ceph-common_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:56.698 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-24T12:40:56.715 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librados2. 2024-01-24T12:40:56.723 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:56.730 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librados2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:56.736 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:40:56.940 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:57.064 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-tempora. 2024-01-24T12:40:57.075 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-01-24T12:40:57.114 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-24T12:40:57.376 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librbd1. 2024-01-24T12:40:57.391 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-librbd1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:57.392 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-portend. 2024-01-24T12:40:57.412 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-01-24T12:40:57.434 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:57.450 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-24T12:40:57.761 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-24T12:40:57.782 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-24T12:40:57.819 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-24T12:40:57.879 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2024-01-24T12:40:57.894 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:57.937 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:57.996 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2024-01-24T12:40:58.016 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-ceph-base_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:58.063 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:58.122 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-24T12:40:58.143 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-24T12:40:58.190 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rados. 2024-01-24T12:40:58.197 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:40:58.204 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-python3-rados_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:58.239 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:58.526 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-24T12:40:58.541 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:58.542 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-natsort. 2024-01-24T12:40:58.563 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-01-24T12:40:58.584 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:58.601 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-24T12:40:58.783 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-24T12:40:58.804 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-24T12:40:58.836 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cephfs. 2024-01-24T12:40:58.841 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:40:58.851 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:58.912 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-logutils. 2024-01-24T12:40:58.919 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:58.933 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-01-24T12:40:58.970 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-24T12:40:59.185 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cheroot. 2024-01-24T12:40:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-24T12:40:59.230 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-24T12:40:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:40:59.246 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:40:59.256 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-24T12:40:59.268 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-24T12:40:59.297 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:40:59.298 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:40:59.576 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-mako. 2024-01-24T12:40:59.596 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-24T12:40:59.634 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:40:59.642 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-prettytable. 2024-01-24T12:40:59.657 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-01-24T12:40:59.700 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-24T12:40:59.780 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-24T12:40:59.801 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-24T12:40:59.838 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:40:59.936 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rbd. 2024-01-24T12:40:59.951 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:40:59.986 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:00.063 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-24T12:41:00.083 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-24T12:41:00.108 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-24T12:41:00.120 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-24T12:41:00.121 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:41:00.149 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:41:00.364 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-24T12:41:00.379 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-24T12:41:00.424 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-24T12:41:00.431 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:41:00.444 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-24T12:41:00.444 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-24T12:41:00.465 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-24T12:41:00.482 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:41:00.502 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:41:00.760 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webob. 2024-01-24T12:41:00.775 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2024-01-24T12:41:00.780 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-24T12:41:00.790 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-librgw2_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:00.813 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempora. 2024-01-24T12:41:00.826 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:41:00.833 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:00.834 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-01-24T12:41:00.872 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-24T12:41:01.196 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-waitress. 2024-01-24T12:41:01.217 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-24T12:41:01.257 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:01.283 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-portend. 2024-01-24T12:41:01.304 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-01-24T12:41:01.319 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rgw. 2024-01-24T12:41:01.334 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:01.341 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-24T12:41:01.378 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:01.549 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-tempita. 2024-01-24T12:41:01.570 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-24T12:41:01.607 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:01.619 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-24T12:41:01.640 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-24T12:41:01.647 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-24T12:41:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-24T12:41:01.677 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-24T12:41:01.697 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:41:01.869 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-paste. 2024-01-24T12:41:01.889 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-24T12:41:01.919 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:01.980 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-24T12:41:02.001 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-24T12:41:02.038 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:41:02.041 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2024-01-24T12:41:02.057 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:02.100 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:02.247 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-24T12:41:02.259 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-24T12:41:02.297 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:02.392 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2024-01-24T12:41:02.413 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-01-24T12:41:02.458 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-24T12:41:02.553 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2024-01-24T12:41:02.568 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-ceph-common_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:02.583 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-24T12:41:02.603 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-24T12:41:02.611 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:02.641 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:41:02.786 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2024-01-24T12:41:02.807 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-01-24T12:41:02.844 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-24T12:41:02.944 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-webtest. 2024-01-24T12:41:02.965 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-01-24T12:41:03.002 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-24T12:41:03.106 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-24T12:41:03.127 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-24T12:41:03.164 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:41:03.314 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pecan. 2024-01-24T12:41:03.334 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-24T12:41:03.372 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:41:03.484 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2024-01-24T12:41:03.504 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-24T12:41:03.542 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:41:03.642 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2024-01-24T12:41:03.657 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-ceph-base_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:03.709 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:03.752 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-certifi. 2024-01-24T12:41:03.772 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-01-24T12:41:03.818 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:03.878 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-24T12:41:03.899 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-24T12:41:03.936 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:41:04.121 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-idna. 2024-01-24T12:41:04.142 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-01-24T12:41:04.179 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-24T12:41:04.222 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-24T12:41:04.244 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-24T12:41:04.281 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:41:04.447 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-24T12:41:04.461 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-24T12:41:04.499 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-urllib3. 2024-01-24T12:41:04.505 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:41:04.520 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-24T12:41:04.557 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:41:04.659 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2024-01-24T12:41:04.679 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-24T12:41:04.708 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:41:04.850 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cheroot. 2024-01-24T12:41:04.864 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-24T12:41:04.886 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-requests. 2024-01-24T12:41:04.906 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-24T12:41:04.916 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:41:04.944 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:41:05.020 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2024-01-24T12:41:05.041 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-24T12:41:05.081 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:05.389 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2024-01-24T12:41:05.486 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-24T12:41:05.486 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:05.486 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-24T12:41:05.487 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-24T12:41:05.487 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:05.751 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2024-01-24T12:41:05.771 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-24T12:41:05.808 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:06.028 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-24T12:41:06.044 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-24T12:41:06.095 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:41:06.105 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-24T12:41:06.116 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-24T12:41:06.145 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:06.489 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-24T12:41:06.504 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-24T12:41:06.555 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:41:06.683 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-24T12:41:06.695 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:06.733 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:06.867 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-24T12:41:06.881 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-24T12:41:06.950 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:41:07.105 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-24T12:41:07.126 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:07.155 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:07.282 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-24T12:41:07.303 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-24T12:41:07.320 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempora. 2024-01-24T12:41:07.334 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-01-24T12:41:07.340 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:41:07.386 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-24T12:41:07.458 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-openssl. 2024-01-24T12:41:07.478 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-01-24T12:41:07.516 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-24T12:41:07.643 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2024-01-24T12:41:07.664 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-01-24T12:41:07.692 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-24T12:41:07.789 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-portend. 2024-01-24T12:41:07.804 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-01-24T12:41:07.856 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-24T12:41:07.860 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr. 2024-01-24T12:41:07.881 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:07.921 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:08.004 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2024-01-24T12:41:08.025 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-24T12:41:08.070 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:41:08.225 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-24T12:41:08.240 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-24T12:41:08.284 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-24T12:41:08.291 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mon. 2024-01-24T12:41:08.312 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:08.349 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:08.450 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-certifi. 2024-01-24T12:41:08.471 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-01-24T12:41:08.508 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:08.628 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-24T12:41:08.643 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-24T12:41:08.695 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:41:08.820 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-idna. 2024-01-24T12:41:08.840 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-01-24T12:41:08.869 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-24T12:41:09.049 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-natsort. 2024-01-24T12:41:09.063 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-01-24T12:41:09.106 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-24T12:41:09.173 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-urllib3. 2024-01-24T12:41:09.194 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-24T12:41:09.230 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:41:09.278 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-osd. 2024-01-24T12:41:09.299 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:09.336 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:09.401 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-logutils. 2024-01-24T12:41:09.416 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-01-24T12:41:09.451 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-24T12:41:09.550 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests. 2024-01-24T12:41:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-24T12:41:09.608 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:41:09.754 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-24T12:41:09.769 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-24T12:41:09.812 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:41:09.945 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-24T12:41:09.966 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-24T12:41:10.003 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:10.132 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-mako. 2024-01-24T12:41:10.147 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-24T12:41:10.207 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:41:10.298 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-24T12:41:10.310 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:10.347 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:10.577 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-24T12:41:10.591 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-24T12:41:10.635 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:41:10.694 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-24T12:41:10.715 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:10.752 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:10.946 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-24T12:41:10.960 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-24T12:41:11.004 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:41:11.055 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2024-01-24T12:41:11.057 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph. 2024-01-24T12:41:11.070 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../061-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:11.076 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-01-24T12:41:11.099 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:11.113 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-24T12:41:11.332 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webob. 2024-01-24T12:41:11.347 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-24T12:41:11.390 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:41:11.402 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-fuse. 2024-01-24T12:41:11.423 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:11.458 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2024-01-24T12:41:11.460 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:11.479 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:11.516 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:11.760 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-waitress. 2024-01-24T12:41:11.775 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-24T12:41:11.821 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:11.856 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mds. 2024-01-24T12:41:11.877 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:11.911 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2024-01-24T12:41:11.914 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:11.932 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:11.960 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:12.113 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempita. 2024-01-24T12:41:12.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-24T12:41:12.163 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:12.301 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephadm. 2024-01-24T12:41:12.322 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../064-cephadm_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:12.359 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:12.449 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-paste. 2024-01-24T12:41:12.464 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-24T12:41:12.507 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:12.679 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-24T12:41:12.699 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-24T12:41:12.737 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:12.802 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-24T12:41:12.817 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-24T12:41:12.860 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:12.931 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2024-01-24T12:41:12.952 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:12.997 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:13.065 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-24T12:41:13.077 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:13.116 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:13.171 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-24T12:41:13.186 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-24T12:41:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:41:13.546 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webtest. 2024-01-24T12:41:13.561 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-01-24T12:41:13.608 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-24T12:41:13.919 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pecan. 2024-01-24T12:41:13.934 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-24T12:41:13.977 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:41:14.204 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-babel. 2024-01-24T12:41:14.217 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:14.263 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-certifi. 2024-01-24T12:41:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-01-24T12:41:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:14.566 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-jinja2. 2024-01-24T12:41:14.588 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2024-01-24T12:41:14.616 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-24T12:41:14.685 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-idna. 2024-01-24T12:41:14.700 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-01-24T12:41:14.751 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-24T12:41:14.937 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-24T12:41:14.958 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:14.995 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:15.071 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-urllib3. 2024-01-24T12:41:15.086 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-24T12:41:15.129 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:41:15.367 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2024-01-24T12:41:15.380 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:15.417 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:15.499 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests. 2024-01-24T12:41:15.514 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-24T12:41:15.549 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-24T12:41:15.557 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:41:15.570 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-24T12:41:15.615 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:15.736 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2024-01-24T12:41:15.757 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:15.794 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:15.852 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-24T12:41:15.867 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-24T12:41:15.919 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pluggy. 2024-01-24T12:41:15.935 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:15.940 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-24T12:41:15.977 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:41:16.158 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2024-01-24T12:41:16.179 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:16.216 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:16.221 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-24T12:41:16.236 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:16.280 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:16.289 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-py. 2024-01-24T12:41:16.310 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-01-24T12:41:16.347 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-24T12:41:16.611 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2024-01-24T12:41:16.632 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-cephadm_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:16.669 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:16.676 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-24T12:41:16.691 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:16.726 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-24T12:41:16.734 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:16.747 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-24T12:41:16.784 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:16.947 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-24T12:41:16.968 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-24T12:41:16.997 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:17.046 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-toml. 2024-01-24T12:41:17.046 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-openssl. 2024-01-24T12:41:17.061 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-01-24T12:41:17.063 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-01-24T12:41:17.104 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-24T12:41:17.129 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-24T12:41:17.359 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-24T12:41:17.380 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:17.417 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:17.424 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pytest. 2024-01-24T12:41:17.445 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-24T12:41:17.482 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:41:17.707 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2024-01-24T12:41:17.722 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:17.757 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:17.812 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-24T12:41:17.832 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-01-24T12:41:17.870 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:18.085 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2024-01-24T12:41:18.100 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:18.143 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:18.182 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-routes. 2024-01-24T12:41:18.202 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-24T12:41:18.240 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:18.472 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-babel. 2024-01-24T12:41:18.494 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:18.538 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:18.585 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-24T12:41:18.606 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:18.643 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:18.834 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2024-01-24T12:41:18.855 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2024-01-24T12:41:18.883 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-24T12:41:18.955 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2024-01-24T12:41:18.970 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:19.013 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:19.056 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-24T12:41:19.077 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-24T12:41:19.114 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:19.203 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-24T12:41:19.225 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:19.261 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:19.582 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-24T12:41:19.604 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-24T12:41:19.635 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-joblib. 2024-01-24T12:41:19.648 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:19.656 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-24T12:41:19.693 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:19.943 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2024-01-24T12:41:19.964 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-24T12:41:20.001 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:41:20.013 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-24T12:41:20.026 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-24T12:41:20.072 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:20.192 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2024-01-24T12:41:20.207 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-ceph_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:20.242 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:20.329 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2024-01-24T12:41:20.350 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-01-24T12:41:20.367 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-sklearn. 2024-01-24T12:41:20.387 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-24T12:41:20.388 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-24T12:41:20.425 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:20.536 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2024-01-24T12:41:20.551 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:20.594 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:20.750 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-24T12:41:20.770 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-24T12:41:20.807 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:20.981 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2024-01-24T12:41:20.996 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:21.039 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:21.094 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-toml. 2024-01-24T12:41:21.115 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-01-24T12:41:21.152 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-24T12:41:21.279 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-24T12:41:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:21.328 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:21.401 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephadm. 2024-01-24T12:41:21.415 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-cephadm_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:21.455 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2024-01-24T12:41:21.458 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:21.476 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-24T12:41:21.513 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:41:21.795 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-24T12:41:21.809 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-24T12:41:21.850 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-24T12:41:21.853 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:21.871 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-01-24T12:41:21.908 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:22.190 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-24T12:41:22.204 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:22.211 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2024-01-24T12:41:22.233 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-24T12:41:22.247 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:22.270 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:22.299 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-cachetools. 2024-01-24T12:41:22.320 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-01-24T12:41:22.357 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:22.606 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-24T12:41:22.628 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:22.635 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-24T12:41:22.656 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-24T12:41:22.673 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:22.693 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:41:23.031 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-24T12:41:23.052 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-24T12:41:23.089 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:41:23.110 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-24T12:41:23.123 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-24T12:41:23.151 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:23.153 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-babel. 2024-01-24T12:41:23.166 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-24T12:41:23.211 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:23.401 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-rsa. 2024-01-24T12:41:23.422 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-01-24T12:41:23.459 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-24T12:41:23.531 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jinja2. 2024-01-24T12:41:23.544 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2024-01-24T12:41:23.580 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-24T12:41:23.663 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2024-01-24T12:41:23.685 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-24T12:41:23.730 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:23.738 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-google-auth. 2024-01-24T12:41:23.760 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-01-24T12:41:23.797 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-24T12:41:23.928 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-24T12:41:23.941 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:23.986 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:24.067 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-24T12:41:24.089 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-24T12:41:24.117 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-24T12:41:24.125 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:24.139 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-24T12:41:24.175 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:41:24.281 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-24T12:41:24.295 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-24T12:41:24.339 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:24.436 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2024-01-24T12:41:24.458 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-24T12:41:24.487 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-websocket. 2024-01-24T12:41:24.503 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:24.509 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-01-24T12:41:24.554 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-24T12:41:24.667 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pluggy. 2024-01-24T12:41:24.680 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-24T12:41:24.725 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:41:24.883 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-24T12:41:24.904 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-24T12:41:24.941 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:41:25.062 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-py. 2024-01-24T12:41:25.075 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-01-24T12:41:25.120 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-24T12:41:25.448 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-24T12:41:25.462 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-24T12:41:25.506 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:25.522 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-24T12:41:25.548 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:25.588 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:25.664 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-24T12:41:25.676 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:25.722 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:25.818 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-toml. 2024-01-24T12:41:25.832 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-01-24T12:41:25.876 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-24T12:41:26.129 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pytest. 2024-01-24T12:41:26.143 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-24T12:41:26.195 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:41:26.267 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-24T12:41:26.289 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-24T12:41:26.333 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:41:26.607 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-24T12:41:26.621 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-01-24T12:41:26.666 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:26.692 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2024-01-24T12:41:26.713 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-01-24T12:41:26.758 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:26.762 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-24T12:41:26.783 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:26.820 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:41:26.969 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-routes. 2024-01-24T12:41:26.983 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-24T12:41:27.019 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-24T12:41:27.027 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:27.040 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package jq. 2024-01-24T12:41:27.041 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-24T12:41:27.052 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:27.077 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:41:27.090 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-24T12:41:27.326 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package socat. 2024-01-24T12:41:27.330 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-24T12:41:27.338 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-24T12:41:27.344 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:27.376 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:27.388 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:27.398 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-24T12:41:27.419 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-24T12:41:27.464 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:41:27.688 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package xmlstarlet. 2024-01-24T12:41:27.709 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-24T12:41:27.754 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:41:27.767 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-24T12:41:27.781 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-24T12:41:27.801 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2024-01-24T12:41:27.823 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-01-24T12:41:27.825 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:27.867 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-24T12:41:28.134 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-test. 2024-01-24T12:41:28.153 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../098-ceph-test_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:28.188 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2024-01-24T12:41:28.192 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:28.210 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-01-24T12:41:28.254 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-24T12:41:28.329 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-joblib. 2024-01-24T12:41:28.343 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-24T12:41:28.387 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:28.574 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-24T12:41:28.595 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-24T12:41:28.641 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:41:28.773 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-24T12:41:28.787 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-24T12:41:28.832 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:28.936 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2024-01-24T12:41:28.954 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-01-24T12:41:28.994 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-24T12:41:29.143 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn. 2024-01-24T12:41:29.157 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-24T12:41:29.201 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:29.314 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-24T12:41:29.336 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-24T12:41:29.388 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:41:29.987 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-24T12:41:30.001 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:30.045 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:30.086 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-24T12:41:30.099 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:30.169 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:30.489 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-24T12:41:30.506 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ceph-volume. 2024-01-24T12:41:30.510 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-24T12:41:30.527 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:30.555 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:41:30.572 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:30.892 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-24T12:41:30.913 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:30.958 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:41:30.977 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-24T12:41:30.990 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cachetools. 2024-01-24T12:41:30.999 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:31.005 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-01-24T12:41:31.048 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:31.052 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:31.194 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2024-01-24T12:41:31.207 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:31.244 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-24T12:41:31.376 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-24T12:41:31.391 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-24T12:41:31.434 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:41:31.456 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-colorama. 2024-01-24T12:41:31.477 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-01-24T12:41:31.513 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2024-01-24T12:41:31.526 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-24T12:41:31.531 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-24T12:41:31.563 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:31.771 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-24T12:41:31.786 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-24T12:41:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:41:31.842 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-shell. 2024-01-24T12:41:31.864 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:31.900 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2024-01-24T12:41:31.917 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:31.922 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-24T12:41:31.975 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:41:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rsa. 2024-01-24T12:41:32.115 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-01-24T12:41:32.157 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-24T12:41:32.204 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package cephfs-top. 2024-01-24T12:41:32.225 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:32.279 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:32.329 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2024-01-24T12:41:32.342 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-ceph-test_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:32.379 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:32.511 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-google-auth. 2024-01-24T12:41:32.526 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-01-24T12:41:32.569 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-24T12:41:32.582 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-24T12:41:32.603 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:32.657 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:33.110 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package nvme-cli. 2024-01-24T12:41:33.132 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-24T12:41:33.147 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-24T12:41:33.163 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-24T12:41:33.185 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:33.205 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:41:33.525 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-websocket. 2024-01-24T12:41:33.540 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-01-24T12:41:33.541 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-24T12:41:33.562 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-24T12:41:33.583 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-24T12:41:33.599 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:33.878 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-24T12:41:33.895 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-24T12:41:33.928 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:41:34.053 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pastescript. 2024-01-24T12:41:34.074 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-01-24T12:41:34.119 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-24T12:41:34.440 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-psutil. 2024-01-24T12:41:34.461 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-24T12:41:34.506 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:34.558 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-24T12:41:34.575 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:34.616 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:34.852 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pygments. 2024-01-24T12:41:34.873 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-24T12:41:34.917 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2024-01-24T12:41:34.918 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:34.936 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-24T12:41:34.939 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:34.950 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-24T12:41:34.984 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:34.994 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:41:35.338 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-24T12:41:35.347 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-24T12:41:35.360 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:35.362 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:35.404 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:35.405 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:41:35.431 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-24T12:41:35.453 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-24T12:41:35.497 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:35.667 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2024-01-24T12:41:35.681 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-24T12:41:35.724 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-24T12:41:35.784 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package python3-simplejson. 2024-01-24T12:41:35.800 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-24T12:41:35.834 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:35.974 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-colorama. 2024-01-24T12:41:35.994 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2024-01-24T12:41:35.995 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-01-24T12:41:36.009 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-24T12:41:36.040 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-24T12:41:36.061 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:36.070 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-24T12:41:36.083 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-24T12:41:36.112 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:36.310 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-shell. 2024-01-24T12:41:36.314 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2024-01-24T12:41:36.329 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-24T12:41:36.332 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:36.442 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:41:36.442 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:36.613 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-top. 2024-01-24T12:41:36.626 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:36.654 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:36.735 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2024-01-24T12:41:36.749 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-ceph-test_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:36.785 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:36.891 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-24T12:41:36.912 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:36.957 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:37.126 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package radosgw. 2024-01-24T12:41:37.148 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../113-radosgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:37.183 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:37.335 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2024-01-24T12:41:37.357 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-24T12:41:37.401 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:37.764 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-24T12:41:37.777 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-24T12:41:37.814 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:37.937 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package rbd-fuse. 2024-01-24T12:41:37.959 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:38.003 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:38.251 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2024-01-24T12:41:38.264 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-01-24T12:41:38.301 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-24T12:41:38.322 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:38.567 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:41:38.597 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-volume. 2024-01-24T12:41:38.612 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2024-01-24T12:41:38.613 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:38.626 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-24T12:41:38.654 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:38.655 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:38.677 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:38.938 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-24T12:41:38.999 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pygments. 2024-01-24T12:41:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-24T12:41:39.021 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-24T12:41:39.024 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:39.065 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:39.067 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:39.254 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-24T12:41:39.354 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-colorama. 2024-01-24T12:41:39.369 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-01-24T12:41:39.404 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-24T12:41:39.520 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-24T12:41:39.542 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-24T12:41:39.586 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:39.648 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-shell. 2024-01-24T12:41:39.664 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:39.706 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:39.741 INFO:teuthology.orchestra.run.smithi124.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-24T12:41:39.813 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:39.905 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2024-01-24T12:41:39.927 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-24T12:41:39.959 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-top. 2024-01-24T12:41:39.972 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:39.974 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-341-g4e3182a6-1jammy_all.deb ... 2024-01-24T12:41:40.018 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:40.250 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-24T12:41:40.272 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-24T12:41:40.296 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-24T12:41:40.311 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:40.316 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:40.353 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:40.365 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user cephadm....done 2024-01-24T12:41:40.520 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:40.665 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2024-01-24T12:41:40.681 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-24T12:41:40.748 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:40.796 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:41:41.056 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:41.070 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-24T12:41:41.085 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-24T12:41:41.104 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2024-01-24T12:41:41.119 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:41.127 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../113-radosgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:41.170 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:41.191 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:41:41.450 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:41.522 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastescript. 2024-01-24T12:41:41.536 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-01-24T12:41:41.572 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-24T12:41:41.710 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:41:41.836 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-24T12:41:41.842 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-psutil. 2024-01-24T12:41:41.857 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-24T12:41:41.892 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:41.998 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2024-01-24T12:41:42.012 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:42.056 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:42.163 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:42.204 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pygments. 2024-01-24T12:41:42.218 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-24T12:41:42.253 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:42.359 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:42.548 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:42.611 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:41:42.690 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-24T12:41:42.705 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-24T12:41:42.737 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:42.749 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:42.792 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-24T12:41:42.999 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-24T12:41:43.051 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-24T12:41:43.052 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplejson. 2024-01-24T12:41:43.066 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-24T12:41:43.135 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:43.319 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:43.355 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-24T12:41:43.404 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-24T12:41:43.419 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-24T12:41:43.462 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:43.571 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:43.830 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:43.864 INFO:teuthology.orchestra.run.smithi027.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-24T12:41:43.956 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:44.081 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:44.266 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2024-01-24T12:41:44.280 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../113-radosgw_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:44.324 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:44.341 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:44.459 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-24T12:41:44.558 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2024-01-24T12:41:44.696 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:44.702 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:41:44.869 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2024-01-24T12:41:44.884 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-341-g4e3182a6-1jammy_amd64.deb ... 2024-01-24T12:41:44.935 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:44.972 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:41:44.978 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:41:45.105 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:45.223 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:45.244 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-24T12:41:45.349 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:41:45.489 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:45.507 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-24T12:41:45.591 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-24T12:41:45.608 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-24T12:41:45.626 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:45.859 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-24T12:41:45.911 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:41:46.118 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:46.153 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-24T12:41:46.268 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-24T12:41:46.428 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:46.471 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:46.833 INFO:teuthology.orchestra.run.smithi195.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-24T12:41:46.839 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:46.867 INFO:teuthology.orchestra.run.smithi195.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-24T12:41:46.909 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:47.107 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-24T12:41:47.372 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:47.375 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-24T12:41:47.479 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user cephadm....done 2024-01-24T12:41:47.623 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:47.648 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-24T12:41:47.652 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:47.750 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:47.876 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:41:47.908 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-24T12:41:47.920 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:48.152 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:48.176 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-24T12:41:48.196 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:48.562 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:48.577 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-24T12:41:48.605 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:48.813 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:48.845 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-24T12:41:48.881 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:49.016 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-24T12:41:49.121 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-24T12:41:49.182 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:41:49.272 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-24T12:41:49.325 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:41:49.468 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-24T12:41:49.593 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:41:49.607 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-24T12:41:49.711 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:49.769 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:49.984 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-24T12:41:50.095 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:50.121 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:41:50.227 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-24T12:41:50.246 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-24T12:41:50.364 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:50.465 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:50.478 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-24T12:41:50.598 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:50.742 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-idna (3.3-1) ... 2024-01-24T12:41:50.796 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-24T12:41:50.874 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:51.043 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:51.139 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-24T12:41:51.425 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:51.431 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-24T12:41:51.699 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-argparse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:51.992 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-24T12:41:52.143 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-24T12:41:52.186 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:52.208 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:41:52.351 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-24T12:41:52.411 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-24T12:41:52.462 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:52.588 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:52.611 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:41:52.679 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:41:52.714 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:41:52.737 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:41:52.788 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-24T12:41:52.863 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:41:53.023 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:53.131 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:53.165 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:41:53.257 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-24T12:41:53.399 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-24T12:41:53.424 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:53.525 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-24T12:41:53.659 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:41:53.701 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:53.786 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:41:53.834 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-24T12:41:53.912 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:41:54.077 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:41:54.127 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-24T12:41:54.222 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:41:54.379 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-24T12:41:54.473 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-24T12:41:54.705 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:54.716 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-24T12:41:54.846 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-24T12:41:54.967 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:41:55.096 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-24T12:41:55.114 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:41:55.218 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-24T12:41:55.222 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-24T12:41:55.365 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:55.373 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-24T12:41:55.478 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:41:55.492 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:55.604 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-24T12:41:55.683 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-24T12:41:55.801 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-idna (3.3-1) ... 2024-01-24T12:41:55.897 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:41:56.024 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:41:56.084 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-24T12:41:56.111 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:56.317 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:41:56.327 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-24T12:41:56.618 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:41:56.712 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-24T12:41:56.869 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:41:57.005 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-24T12:41:57.301 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-24T12:41:57.306 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-24T12:41:57.350 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:41:57.509 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-24T12:41:57.657 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-24T12:41:57.689 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:41:57.785 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:41:57.815 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:41:57.912 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:41:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-24T12:41:58.037 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:41:58.052 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:41:58.200 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:41:58.347 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:41:58.352 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-idna (3.3-1) ... 2024-01-24T12:41:58.502 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-24T12:41:58.623 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-24T12:41:58.712 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-24T12:41:58.753 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:41:58.880 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-24T12:41:58.883 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:41:59.036 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:41:59.187 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:41:59.206 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:41:59.490 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:41:59.505 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:41:59.764 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-24T12:41:59.784 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-24T12:41:59.910 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-24T12:41:59.925 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:42:00.057 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-24T12:42:00.061 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-24T12:42:00.186 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-24T12:42:00.320 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-24T12:42:00.333 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:42:00.428 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-24T12:42:00.479 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:42:00.529 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-24T12:42:00.601 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-24T12:42:00.755 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:42:00.814 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-24T12:42:00.877 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:42:01.003 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-24T12:42:01.082 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-24T12:42:01.132 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-24T12:42:01.313 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:42:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:42:01.400 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:42:01.447 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:42:01.450 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-01-24T12:42:01.552 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-24T12:42:01.728 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:42:01.748 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:42:01.853 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-24T12:42:01.854 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:01.980 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:02.074 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:42:02.096 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-24T12:42:02.184 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:02.319 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:02.350 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:42:02.389 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-24T12:42:02.478 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:02.604 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-24T12:42:02.648 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-24T12:42:02.713 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-24T12:42:02.908 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-24T12:42:02.923 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:02.970 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:42:03.024 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:03.097 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:42:03.142 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:03.208 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-24T12:42:03.309 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-24T12:42:03.358 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:03.358 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:03.498 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:42:03.769 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-24T12:42:03.774 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-24T12:42:03.860 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:03.895 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-24T12:42:03.987 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:04.050 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:42:04.113 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:04.188 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-24T12:42:04.201 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-24T12:42:04.239 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:42:04.514 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-24T12:42:04.552 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:42:04.774 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-24T12:42:04.862 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:42:05.155 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-24T12:42:05.194 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-24T12:42:05.281 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-24T12:42:05.378 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:05.464 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-24T12:42:05.512 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:05.557 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-24T12:42:05.594 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-24T12:42:05.638 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:05.756 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:05.858 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:42:05.866 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:05.971 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-24T12:42:05.975 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:06.143 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:42:06.272 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-24T12:42:06.523 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-24T12:42:06.536 INFO:teuthology.orchestra.run.smithi124.stdout:Adding group ceph....done 2024-01-24T12:42:06.586 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-24T12:42:06.682 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-24T12:42:06.921 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:42:06.937 INFO:teuthology.orchestra.run.smithi124.stdout:Adding system user ceph....done 2024-01-24T12:42:07.008 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-24T12:42:07.115 INFO:teuthology.orchestra.run.smithi124.stdout:Setting system user ceph properties....done 2024-01-24T12:42:07.126 INFO:teuthology.orchestra.run.smithi124.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-24T12:42:07.262 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-24T12:42:07.281 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:42:07.317 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-24T12:42:07.424 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:07.575 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:07.577 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-24T12:42:07.592 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-24T12:42:07.686 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-24T12:42:07.812 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:07.963 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-24T12:42:07.963 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.097 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.153 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.222 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-24T12:42:08.223 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-24T12:42:08.367 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:08.367 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:08.506 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-24T12:42:08.516 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.634 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.752 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.900 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-24T12:42:08.921 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:08.971 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:08.971 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:09.047 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.192 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-24T12:42:09.530 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-24T12:42:09.564 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:09.564 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:09.595 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.661 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.722 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.790 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.848 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:09.985 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-mod-ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.016 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:42:10.086 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.100 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.204 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.355 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-24T12:42:10.550 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-24T12:42:10.640 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.766 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-modules-core (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:10.925 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.046 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.133 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:11.133 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-24T12:42:11.322 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:11.323 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:11.333 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.503 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.654 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.743 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.805 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.832 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.861 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rados (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.931 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:11.988 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-top (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:12.052 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:12.052 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:12.057 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:12.214 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-24T12:42:12.567 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:12.667 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2024-01-24T12:42:12.929 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:12.930 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:13.086 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2024-01-24T12:42:13.228 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2024-01-24T12:42:13.243 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-24T12:42:13.384 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-24T12:42:13.461 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.582 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rbd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.587 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.708 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.739 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.755 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-24T12:42:13.876 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:13.951 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:13.952 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:13.994 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cephfs (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.095 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-shell (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.204 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.308 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.465 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:14.608 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.765 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2024-01-24T12:42:14.768 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:14.919 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:15.069 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:15.175 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2024-01-24T12:42:15.272 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:42:15.295 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:15.378 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2024-01-24T12:42:15.398 INFO:teuthology.orchestra.run.smithi195.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-24T12:42:15.538 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-24T12:42:15.812 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:15.812 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:15.937 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-24T12:42:16.049 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:42:16.339 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:16.515 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:42:16.518 DEBUG:teuthology.orchestra.run.smithi124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-24T12:42:16.618 INFO:teuthology.orchestra.run.smithi124.stdout:Reading package lists... 2024-01-24T12:42:16.639 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-mirror (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:16.694 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-24T12:42:16.807 INFO:teuthology.orchestra.run.smithi124.stdout:Building dependency tree... 2024-01-24T12:42:16.808 INFO:teuthology.orchestra.run.smithi124.stdout:Reading state information... 2024-01-24T12:42:16.847 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:16.847 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:42:16.976 INFO:teuthology.orchestra.run.smithi124.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:42:16.977 INFO:teuthology.orchestra.run.smithi124.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:42:16.977 INFO:teuthology.orchestra.run.smithi124.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-24T12:42:16.977 INFO:teuthology.orchestra.run.smithi124.stdout: python2.7-minimal 2024-01-24T12:42:16.977 INFO:teuthology.orchestra.run.smithi124.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout:The following additional packages will be installed: 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-24T12:42:16.978 INFO:teuthology.orchestra.run.smithi124.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:16.980 INFO:teuthology.orchestra.run.smithi124.stdout:Suggested packages: 2024-01-24T12:42:16.980 INFO:teuthology.orchestra.run.smithi124.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-24T12:42:16.980 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-24T12:42:16.980 INFO:teuthology.orchestra.run.smithi124.stdout: libengine-pkcs11-openssl 2024-01-24T12:42:17.017 INFO:teuthology.orchestra.run.smithi124.stdout:The following NEW packages will be installed: 2024-01-24T12:42:17.017 INFO:teuthology.orchestra.run.smithi124.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-24T12:42:17.018 INFO:teuthology.orchestra.run.smithi124.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:17.019 INFO:teuthology.orchestra.run.smithi124.stdout:The following packages will be upgraded: 2024-01-24T12:42:17.019 INFO:teuthology.orchestra.run.smithi124.stdout: libssl3 2024-01-24T12:42:17.200 INFO:teuthology.orchestra.run.smithi124.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-24T12:42:17.200 INFO:teuthology.orchestra.run.smithi124.stdout:Need to get 54.6 MB of archives. 2024-01-24T12:42:17.200 INFO:teuthology.orchestra.run.smithi124.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-24T12:42:17.200 INFO:teuthology.orchestra.run.smithi124.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-24T12:42:17.233 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:17.473 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:17.521 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:17.522 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:17.599 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:17.677 INFO:teuthology.orchestra.run.smithi124.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-24T12:42:17.934 INFO:teuthology.orchestra.run.smithi124.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-24T12:42:17.968 INFO:teuthology.orchestra.run.smithi124.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-24T12:42:17.970 INFO:teuthology.orchestra.run.smithi124.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-24T12:42:17.975 INFO:teuthology.orchestra.run.smithi124.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-24T12:42:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-24T12:42:17.979 INFO:teuthology.orchestra.run.smithi124.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-24T12:42:17.982 INFO:teuthology.orchestra.run.smithi124.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-24T12:42:17.985 INFO:teuthology.orchestra.run.smithi124.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-24T12:42:18.110 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:18.138 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:18.138 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-24T12:42:18.150 INFO:teuthology.orchestra.run.smithi124.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-24T12:42:18.150 INFO:teuthology.orchestra.run.smithi124.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-24T12:42:18.336 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:18.337 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:18.408 INFO:teuthology.orchestra.run.smithi124.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-24T12:42:18.751 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:18.870 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:19.083 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-24T12:42:19.233 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:19.233 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:19.562 INFO:teuthology.orchestra.run.smithi124.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-24T12:42:19.567 INFO:teuthology.orchestra.run.smithi124.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-24T12:42:19.567 INFO:teuthology.orchestra.run.smithi124.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-24T12:42:19.573 INFO:teuthology.orchestra.run.smithi124.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-24T12:42:19.574 INFO:teuthology.orchestra.run.smithi124.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-24T12:42:19.584 INFO:teuthology.orchestra.run.smithi124.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-24T12:42:19.588 INFO:teuthology.orchestra.run.smithi124.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-24T12:42:19.605 INFO:teuthology.orchestra.run.smithi124.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-24T12:42:19.711 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:19.769 INFO:teuthology.orchestra.run.smithi124.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-24T12:42:19.771 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:19.897 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:19.925 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:19.925 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-24T12:42:20.057 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:20.302 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:20.302 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-24T12:42:20.492 INFO:teuthology.orchestra.run.smithi124.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-24T12:42:20.518 INFO:teuthology.orchestra.run.smithi124.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-24T12:42:20.521 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:20.595 INFO:teuthology.orchestra.run.smithi124.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-24T12:42:20.604 INFO:teuthology.orchestra.run.smithi124.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-24T12:42:20.605 INFO:teuthology.orchestra.run.smithi124.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-24T12:42:20.606 INFO:teuthology.orchestra.run.smithi124.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-24T12:42:20.607 INFO:teuthology.orchestra.run.smithi124.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-24T12:42:20.634 INFO:teuthology.orchestra.run.smithi124.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-24T12:42:20.637 INFO:teuthology.orchestra.run.smithi124.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-24T12:42:20.734 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:20.734 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-24T12:42:20.858 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:21.034 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:21.185 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:21.347 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:21.350 INFO:teuthology.orchestra.run.smithi124.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-24T12:42:21.370 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:21.434 INFO:teuthology.orchestra.run.smithi124.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-24T12:42:21.435 INFO:teuthology.orchestra.run.smithi124.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-24T12:42:21.435 INFO:teuthology.orchestra.run.smithi124.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-24T12:42:21.528 INFO:teuthology.orchestra.run.smithi124.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-24T12:42:21.543 INFO:teuthology.orchestra.run.smithi124.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-24T12:42:21.684 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:21.684 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-24T12:42:21.756 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:42:21.989 INFO:teuthology.orchestra.run.smithi124.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-24T12:42:21.991 INFO:teuthology.orchestra.run.smithi124.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-24T12:42:22.282 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:22.390 INFO:teuthology.orchestra.run.smithi124.stdout:Preconfiguring packages ... 2024-01-24T12:42:22.408 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:22.542 INFO:teuthology.orchestra.run.smithi124.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2024-01-24T12:42:22.551 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:22.759 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:22.760 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-24T12:42:22.799 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:42:22.827 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package flex. 2024-01-24T12:42:22.917 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2024-01-24T12:42:22.921 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:22.967 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-24T12:42:23.282 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:42:23.285 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-24T12:42:23.348 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-24T12:42:23.385 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-cephadm (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:23.512 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:23.528 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:23.543 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-01-24T12:42:23.544 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-01-24T12:42:23.638 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:23.707 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-24T12:42:23.720 INFO:teuthology.orchestra.run.smithi027.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:42:23.721 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:42:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:42:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-24T12:42:23.722 INFO:teuthology.orchestra.run.smithi027.stdout: python2.7-minimal 2024-01-24T12:42:23.722 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:42:23.722 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-01-24T12:42:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-24T12:42:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-24T12:42:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-24T12:42:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-24T12:42:23.723 INFO:teuthology.orchestra.run.smithi027.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:23.724 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-01-24T12:42:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-24T12:42:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-24T12:42:23.724 INFO:teuthology.orchestra.run.smithi027.stdout: libengine-pkcs11-openssl 2024-01-24T12:42:23.764 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-01-24T12:42:23.765 INFO:teuthology.orchestra.run.smithi027.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-24T12:42:23.765 INFO:teuthology.orchestra.run.smithi027.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-24T12:42:23.766 INFO:teuthology.orchestra.run.smithi027.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-24T12:42:23.766 INFO:teuthology.orchestra.run.smithi027.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-24T12:42:23.766 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-24T12:42:23.766 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-24T12:42:23.766 INFO:teuthology.orchestra.run.smithi027.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:23.767 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-01-24T12:42:23.767 INFO:teuthology.orchestra.run.smithi027.stdout: libssl3 2024-01-24T12:42:23.780 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-volume (18.2.1-341-g4e3182a6-1jammy) ... 2024-01-24T12:42:23.839 INFO:teuthology.orchestra.run.smithi027.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-24T12:42:23.839 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 54.6 MB of archives. 2024-01-24T12:42:23.839 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-24T12:42:23.839 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-24T12:42:23.987 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-24T12:42:24.076 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-24T12:42:24.092 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-24T12:42:24.093 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-24T12:42:24.096 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-24T12:42:24.098 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-24T12:42:24.099 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-24T12:42:24.100 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-24T12:42:24.101 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-24T12:42:24.102 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-24T12:42:24.105 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-24T12:42:24.124 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-24T12:42:24.131 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:24.167 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:42:24.567 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-24T12:42:24.570 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-24T12:42:24.627 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-24T12:42:24.631 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-24T12:42:24.631 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-24T12:42:24.638 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-24T12:42:24.640 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-24T12:42:24.650 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-24T12:42:24.651 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-24T12:42:24.684 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-24T12:42:24.684 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-24T12:42:24.697 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-24T12:42:24.719 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-24T12:42:24.723 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-24T12:42:24.723 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-24T12:42:24.724 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-24T12:42:24.724 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-24T12:42:24.736 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-24T12:42:24.737 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-24T12:42:24.742 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package bison. 2024-01-24T12:42:24.831 INFO:teuthology.orchestra.run.smithi124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2024-01-24T12:42:24.835 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:24.895 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:24.925 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:42:25.086 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-24T12:42:25.086 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-24T12:42:25.086 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-24T12:42:25.086 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-24T12:42:25.087 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-24T12:42:25.087 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-24T12:42:25.104 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-24T12:42:25.105 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-24T12:42:25.330 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-24T12:42:25.351 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-24T12:42:25.396 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:25.423 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:42:25.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-24T12:42:25.500 INFO:teuthology.orchestra.run.smithi027.stdout:Preconfiguring packages ... 2024-01-24T12:42:25.500 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-24T12:42:25.659 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 54.6 MB in 1s (41.0 MB/s) 2024-01-24T12:42:25.665 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-24T12:42:25.666 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-24T12:42:25.741 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package dump. 2024-01-24T12:42:25.763 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-24T12:42:25.800 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking dump (0.4b47-3) ... 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-24T12:42:25.817 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-24T12:42:25.818 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-24T12:42:25.819 INFO:teuthology.orchestra.run.smithi195.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:25.820 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-24T12:42:25.820 INFO:teuthology.orchestra.run.smithi195.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-24T12:42:25.820 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-24T12:42:25.820 INFO:teuthology.orchestra.run.smithi195.stdout: libengine-pkcs11-openssl 2024-01-24T12:42:25.831 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package flex. 2024-01-24T12:42:25.868 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-24T12:42:25.870 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-24T12:42:25.871 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-01-24T12:42:25.871 INFO:teuthology.orchestra.run.smithi195.stdout: libssl3 2024-01-24T12:42:25.922 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2024-01-24T12:42:25.927 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-24T12:42:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 54.6 MB of archives. 2024-01-24T12:42:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-24T12:42:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-24T12:42:25.980 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-24T12:42:26.067 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-24T12:42:26.104 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package indent. 2024-01-24T12:42:26.116 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:26.142 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-24T12:42:26.152 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-24T12:42:26.153 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-24T12:42:26.153 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:26.154 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-24T12:42:26.156 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-24T12:42:26.156 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-24T12:42:26.157 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-24T12:42:26.158 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-24T12:42:26.159 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-24T12:42:26.164 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-24T12:42:26.180 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-24T12:42:26.423 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-24T12:42:26.436 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-24T12:42:26.473 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:26.515 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-24T12:42:26.517 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-24T12:42:26.517 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-24T12:42:26.520 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-24T12:42:26.520 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-24T12:42:26.525 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-24T12:42:26.526 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-24T12:42:26.534 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-24T12:42:26.534 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-24T12:42:26.557 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:26.564 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-24T12:42:26.570 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-24T12:42:26.581 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-24T12:42:26.610 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-24T12:42:26.614 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-24T12:42:26.614 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-24T12:42:26.615 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-24T12:42:26.615 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-24T12:42:26.632 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-24T12:42:26.639 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-24T12:42:26.719 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-24T12:42:26.761 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-24T12:42:26.783 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-24T12:42:26.827 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:26.866 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-24T12:42:26.866 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-24T12:42:26.866 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-24T12:42:26.867 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-24T12:42:26.867 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-24T12:42:26.867 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-24T12:42:26.880 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-24T12:42:26.880 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-24T12:42:27.088 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-24T12:42:27.101 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-24T12:42:27.135 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:27.138 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:27.252 INFO:teuthology.orchestra.run.smithi195.stdout:Preconfiguring packages ... 2024-01-24T12:42:27.406 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 54.6 MB in 1s (54.5 MB/s) 2024-01-24T12:42:27.484 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-24T12:42:27.505 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:27.532 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package flex. 2024-01-24T12:42:27.550 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:27.600 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2024-01-24T12:42:27.603 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:27.647 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-24T12:42:27.820 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-24T12:42:27.832 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:27.870 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:27.939 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package bison. 2024-01-24T12:42:28.031 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2024-01-24T12:42:28.036 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:28.091 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:28.242 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:28.421 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-24T12:42:28.517 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-24T12:42:28.539 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-24T12:42:28.583 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:28.714 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libjson-perl. 2024-01-24T12:42:28.736 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-24T12:42:28.774 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-24T12:42:28.832 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:28.928 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package dump. 2024-01-24T12:42:28.951 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-24T12:42:28.986 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking dump (0.4b47-3) ... 2024-01-24T12:42:29.094 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-24T12:42:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-24T12:42:29.169 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:29.273 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package indent. 2024-01-24T12:42:29.296 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:29.340 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:29.547 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package bison. 2024-01-24T12:42:29.600 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-24T12:42:29.615 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2024-01-24T12:42:29.619 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:29.623 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-24T12:42:29.666 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:29.667 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:30.092 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-24T12:42:30.107 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-24T12:42:30.113 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-24T12:42:30.135 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-24T12:42:30.150 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:30.196 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:30.432 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-24T12:42:30.454 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-24T12:42:30.495 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package dump. 2024-01-24T12:42:30.498 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:30.509 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-24T12:42:30.553 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking dump (0.4b47-3) ... 2024-01-24T12:42:30.832 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package indent. 2024-01-24T12:42:30.843 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-24T12:42:30.846 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:30.864 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-24T12:42:30.865 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:30.881 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:30.885 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:30.910 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:30.930 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:31.117 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-24T12:42:31.131 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-24T12:42:31.155 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-24T12:42:31.167 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:31.170 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:31.213 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:31.225 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-24T12:42:31.246 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:31.291 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:31.474 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjson-perl. 2024-01-24T12:42:31.487 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-24T12:42:31.504 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-24T12:42:31.515 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-24T12:42:31.518 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-24T12:42:31.562 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:31.636 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-24T12:42:31.658 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:31.703 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:31.818 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-24T12:42:31.840 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-24T12:42:31.857 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-24T12:42:31.871 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-24T12:42:31.885 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:31.915 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:32.048 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-24T12:42:32.069 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-24T12:42:32.114 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:32.251 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-24T12:42:32.265 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:32.301 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:32.443 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-24T12:42:32.464 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:32.509 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:32.545 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-24T12:42:32.560 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-24T12:42:32.604 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:32.863 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-24T12:42:32.881 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjson-perl. 2024-01-24T12:42:32.884 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:32.895 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-24T12:42:32.921 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:32.940 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-24T12:42:33.251 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-24T12:42:33.265 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-24T12:42:33.309 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:33.358 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-24T12:42:33.380 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:33.424 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:33.736 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-24T12:42:33.758 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:33.803 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:33.997 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-24T12:42:34.019 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:34.030 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-24T12:42:34.043 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:34.063 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:34.072 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:34.333 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-24T12:42:34.355 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:34.399 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:34.551 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-24T12:42:34.564 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-24T12:42:34.601 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:34.702 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-24T12:42:34.724 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:34.739 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-24T12:42:34.754 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:34.768 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:34.797 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:34.954 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package modemmanager. 2024-01-24T12:42:34.976 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:35.021 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:35.091 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-24T12:42:35.107 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-24T12:42:35.121 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-24T12:42:35.144 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-24T12:42:35.149 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:35.188 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:35.452 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-24T12:42:35.467 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:35.510 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:35.516 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-24T12:42:35.538 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:35.582 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:35.645 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager. 2024-01-24T12:42:35.667 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:35.719 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:35.855 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-24T12:42:35.870 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-24T12:42:35.904 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:35.910 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-24T12:42:35.932 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:35.977 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:36.216 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-24T12:42:36.231 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:36.274 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:36.338 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-24T12:42:36.361 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:36.370 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package ppp. 2024-01-24T12:42:36.392 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-24T12:42:36.405 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:36.618 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-24T12:42:36.634 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:36.677 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:36.711 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:36.733 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-24T12:42:36.745 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:36.782 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:37.000 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package pptp-linux. 2024-01-24T12:42:37.010 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-24T12:42:37.013 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-24T12:42:37.023 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:37.042 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:37.051 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:37.071 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-24T12:42:37.087 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:37.129 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:37.303 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-24T12:42:37.325 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-24T12:42:37.370 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:37.440 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-24T12:42:37.456 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:37.490 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:42:37.556 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-24T12:42:37.577 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-24T12:42:37.622 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:37.673 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-24T12:42:37.695 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-24T12:42:37.701 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-24T12:42:37.716 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-24T12:42:37.740 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client-common (238) ... 2024-01-24T12:42:37.759 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:38.011 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-24T12:42:38.033 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:38.034 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package modemmanager. 2024-01-24T12:42:38.057 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:38.069 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:38.100 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:38.279 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-24T12:42:38.294 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-24T12:42:38.346 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:38.707 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package modemmanager. 2024-01-24T12:42:38.722 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-24T12:42:38.723 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager. 2024-01-24T12:42:38.746 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:38.765 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:38.799 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:38.978 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-common. 2024-01-24T12:42:38.999 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-24T12:42:39.062 INFO:teuthology.orchestra.run.smithi124.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-24T12:42:39.092 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-common (238) ... 2024-01-24T12:42:39.390 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ppp. 2024-01-24T12:42:39.412 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-24T12:42:39.481 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager. 2024-01-24T12:42:39.497 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-24T12:42:39.547 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:39.578 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-14. 2024-01-24T12:42:39.599 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:39.646 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:39.723 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:40.019 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pptp-linux. 2024-01-24T12:42:40.041 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-24T12:42:40.086 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:40.196 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ppp. 2024-01-24T12:42:40.211 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-24T12:42:40.339 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-24T12:42:40.361 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-24T12:42:40.397 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:40.547 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:40.700 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-24T12:42:40.722 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-24T12:42:40.766 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client-common (238) ... 2024-01-24T12:42:40.866 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pptp-linux. 2024-01-24T12:42:40.881 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-24T12:42:40.925 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:41.047 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql. 2024-01-24T12:42:41.060 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-24T12:42:41.078 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-24T12:42:41.088 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql (14+238) ... 2024-01-24T12:42:41.101 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:41.145 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:41.185 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-24T12:42:41.200 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-24T12:42:41.235 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:41.332 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-client. 2024-01-24T12:42:41.345 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-24T12:42:41.382 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-client (14+238) ... 2024-01-24T12:42:41.505 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-24T12:42:41.520 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-24T12:42:41.563 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-common (238) ... 2024-01-24T12:42:41.626 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-24T12:42:41.639 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-24T12:42:41.676 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-24T12:42:41.758 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-common. 2024-01-24T12:42:41.780 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-24T12:42:41.843 INFO:teuthology.orchestra.run.smithi027.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-24T12:42:41.873 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-common (238) ... 2024-01-24T12:42:41.884 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-24T12:42:41.898 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:41.942 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:41.995 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package tcl8.6. 2024-01-24T12:42:42.017 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:42.062 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:42.324 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-14. 2024-01-24T12:42:42.346 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:42.357 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package tcl. 2024-01-24T12:42:42.379 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-24T12:42:42.394 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:42.427 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-24T12:42:42.597 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-common. 2024-01-24T12:42:42.611 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-24T12:42:42.673 INFO:teuthology.orchestra.run.smithi195.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-24T12:42:42.703 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-common (238) ... 2024-01-24T12:42:42.776 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package wpasupplicant. 2024-01-24T12:42:42.798 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-24T12:42:42.843 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:43.121 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-14. 2024-01-24T12:42:43.135 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-24T12:42:43.182 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:43.214 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-24T12:42:43.226 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-24T12:42:43.264 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:43.701 INFO:teuthology.orchestra.run.smithi124.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-24T12:42:43.722 INFO:teuthology.orchestra.run.smithi124.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-24T12:42:43.774 INFO:teuthology.orchestra.run.smithi124.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:43.785 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql. 2024-01-24T12:42:43.799 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-24T12:42:43.843 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql (14+238) ... 2024-01-24T12:42:44.068 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client-common (238) ... 2024-01-24T12:42:44.269 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client. 2024-01-24T12:42:44.283 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-24T12:42:44.292 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-24T12:42:44.391 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client (14+238) ... 2024-01-24T12:42:44.407 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:44.425 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql. 2024-01-24T12:42:44.439 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-24T12:42:44.482 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql (14+238) ... 2024-01-24T12:42:44.534 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:44.635 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-24T12:42:44.650 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-24T12:42:44.659 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:44.694 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-24T12:42:44.768 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client. 2024-01-24T12:42:44.769 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:44.782 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-24T12:42:44.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client (14+238) ... 2024-01-24T12:42:44.870 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:45.030 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package tcl8.6. 2024-01-24T12:42:45.052 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:45.096 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:45.315 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-24T12:42:45.329 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-24T12:42:45.366 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package tcl. 2024-01-24T12:42:45.372 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-24T12:42:45.373 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-24T12:42:45.388 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-24T12:42:45.437 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-24T12:42:45.468 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:45.708 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl8.6. 2024-01-24T12:42:45.724 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-24T12:42:45.766 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:45.776 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package wpasupplicant. 2024-01-24T12:42:45.799 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-24T12:42:45.830 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:45.830 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:45.835 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:46.077 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl. 2024-01-24T12:42:46.094 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-24T12:42:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-24T12:42:46.181 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-24T12:42:46.204 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-24T12:42:46.247 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:46.387 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:46.472 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package wpasupplicant. 2024-01-24T12:42:46.488 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-24T12:42:46.513 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:46.530 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:46.639 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:46.650 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-24T12:42:46.673 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-24T12:42:46.726 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:46.774 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:46.884 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-24T12:42:46.900 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-24T12:42:46.908 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:46.943 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:47.027 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client-common (238) ... 2024-01-24T12:42:47.034 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:47.144 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:47.232 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-24T12:42:47.345 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-24T12:42:47.351 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:47.361 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-24T12:42:47.412 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:47.475 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:47.601 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:47.727 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:47.755 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-common (238) ... 2024-01-24T12:42:47.816 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:47.853 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:47.960 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-24T12:42:48.032 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up dump (0.4b47-3) ... 2024-01-24T12:42:48.069 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-24T12:42:48.160 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-24T12:42:48.179 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:48.218 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:48.336 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:48.338 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-24T12:42:48.378 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-24T12:42:48.459 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:48.462 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-24T12:42:48.464 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-24T12:42:48.588 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-24T12:42:48.590 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:48.763 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:48.842 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:48.843 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:49.255 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-24T12:42:49.325 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:49.420 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:49.450 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:49.546 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-24T12:42:49.554 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:49.610 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:49.637 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-24T12:42:49.680 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:49.728 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:49.808 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:49.854 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:49.932 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:50.015 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:50.015 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-24T12:42:50.022 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-client (14+238) ... 2024-01-24T12:42:50.050 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:50.148 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:50.175 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:50.634 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:50.634 INFO:teuthology.orchestra.run.smithi124.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-24T12:42:50.635 INFO:teuthology.orchestra.run.smithi124.stdout:which means they are currently configured by ifupdown: 2024-01-24T12:42:50.635 INFO:teuthology.orchestra.run.smithi124.stdout:- enp3s0f1 2024-01-24T12:42:50.635 INFO:teuthology.orchestra.run.smithi124.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-24T12:42:50.635 INFO:teuthology.orchestra.run.smithi124.stdout:remove their configuration from /etc/network/interfaces. 2024-01-24T12:42:50.635 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:50.666 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-24T12:42:50.751 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-24T12:42:50.783 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-24T12:42:50.856 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:50.884 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-24T12:42:50.974 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up dump (0.4b47-3) ... 2024-01-24T12:42:50.985 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-24T12:42:51.102 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:51.107 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-24T12:42:51.167 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-24T12:42:51.233 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:51.253 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-24T12:42:51.379 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-24T12:42:51.384 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:51.473 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-24T12:42:51.511 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-24T12:42:51.636 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-24T12:42:51.779 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:51.885 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-24T12:42:51.964 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:52.076 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:52.110 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-24T12:42:52.123 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:52.211 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:52.227 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up dump (0.4b47-3) ... 2024-01-24T12:42:52.322 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-24T12:42:52.328 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:52.333 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:52.413 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:42:52.454 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-common (238) ... 2024-01-24T12:42:52.484 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:52.541 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-24T12:42:52.627 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:52.667 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-24T12:42:52.793 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-24T12:42:52.795 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client (14+238) ... 2024-01-24T12:42:52.910 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-24T12:42:52.954 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-24T12:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-24T12:42:53.213 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-24T12:42:53.383 INFO:teuthology.orchestra.run.smithi124.stdout:Adding user postgres to group ssl-cert 2024-01-24T12:42:53.389 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-24T12:42:53.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:53.496 INFO:teuthology.orchestra.run.smithi027.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-24T12:42:53.496 INFO:teuthology.orchestra.run.smithi027.stdout:which means they are currently configured by ifupdown: 2024-01-24T12:42:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:- ens1f0 2024-01-24T12:42:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-24T12:42:53.497 INFO:teuthology.orchestra.run.smithi027.stdout:remove their configuration from /etc/network/interfaces. 2024-01-24T12:42:53.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:53.515 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:53.572 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:53.572 INFO:teuthology.orchestra.run.smithi124.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-24T12:42:53.629 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-24T12:42:53.675 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-24T12:42:53.756 INFO:teuthology.orchestra.run.smithi124.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-24T12:42:53.756 INFO:teuthology.orchestra.run.smithi124.stdout:Removing obsolete dictionary files: 2024-01-24T12:42:53.842 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client (14+238) ... 2024-01-24T12:42:53.952 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-24T12:42:53.976 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-24T12:42:54.294 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-24T12:42:54.321 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-24T12:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-24T12:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout:which means they are currently configured by ifupdown: 2024-01-24T12:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout:- enp3s0f1 2024-01-24T12:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-24T12:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout:remove their configuration from /etc/network/interfaces. 2024-01-24T12:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:54.671 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-24T12:42:54.672 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:54.982 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:54.989 INFO:teuthology.orchestra.run.smithi124.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-24T12:42:55.025 INFO:teuthology.orchestra.run.smithi124.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-24T12:42:55.064 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-24T12:42:55.077 INFO:teuthology.orchestra.run.smithi124.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:This user must also own the server process. 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:The database cluster will be initialized with locale "en_US". 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:The default text search configuration will be set to "english". 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:Data page checksums are disabled. 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:creating subdirectories ... ok 2024-01-24T12:42:55.078 INFO:teuthology.orchestra.run.smithi124.stdout:selecting dynamic shared memory implementation ... posix 2024-01-24T12:42:55.094 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default max_connections ... 100 2024-01-24T12:42:55.113 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default shared_buffers ... 128MB 2024-01-24T12:42:55.131 INFO:teuthology.orchestra.run.smithi124.stdout:selecting default time zone ... Etc/UTC 2024-01-24T12:42:55.133 INFO:teuthology.orchestra.run.smithi124.stdout:creating configuration files ... ok 2024-01-24T12:42:55.150 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:55.255 INFO:teuthology.orchestra.run.smithi124.stdout:running bootstrap script ... ok 2024-01-24T12:42:55.301 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:55.436 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-common (238) ... 2024-01-24T12:42:55.471 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-24T12:42:55.966 INFO:teuthology.orchestra.run.smithi124.stdout:performing post-bootstrap initialization ... ok 2024-01-24T12:42:56.155 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-24T12:42:56.302 INFO:teuthology.orchestra.run.smithi027.stdout:Adding user postgres to group ssl-cert 2024-01-24T12:42:56.306 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-24T12:42:56.440 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-24T12:42:56.502 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:56.502 INFO:teuthology.orchestra.run.smithi027.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-24T12:42:56.566 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-common (238) ... 2024-01-24T12:42:56.693 INFO:teuthology.orchestra.run.smithi027.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-24T12:42:56.693 INFO:teuthology.orchestra.run.smithi027.stdout:Removing obsolete dictionary files: 2024-01-24T12:42:56.726 INFO:teuthology.orchestra.run.smithi124.stdout:syncing data to disk ... ok 2024-01-24T12:42:57.119 INFO:teuthology.orchestra.run.smithi124.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-24T12:42:57.325 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-24T12:42:57.561 INFO:teuthology.orchestra.run.smithi195.stdout:Adding user postgres to group ssl-cert 2024-01-24T12:42:57.737 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:57.850 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:57.850 INFO:teuthology.orchestra.run.smithi195.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-24T12:42:58.067 INFO:teuthology.orchestra.run.smithi027.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-24T12:42:58.088 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-24T12:42:58.097 INFO:teuthology.orchestra.run.smithi195.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-24T12:42:58.097 INFO:teuthology.orchestra.run.smithi195.stdout:Removing obsolete dictionary files: 2024-01-24T12:42:58.124 INFO:teuthology.orchestra.run.smithi027.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:This user must also own the server process. 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:The database cluster will be initialized with locale "en_US". 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:The default text search configuration will be set to "english". 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:Data page checksums are disabled. 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:creating subdirectories ... ok 2024-01-24T12:42:58.125 INFO:teuthology.orchestra.run.smithi027.stdout:selecting dynamic shared memory implementation ... posix 2024-01-24T12:42:58.138 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default max_connections ... 100 2024-01-24T12:42:58.160 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default shared_buffers ... 128MB 2024-01-24T12:42:58.176 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default time zone ... Etc/UTC 2024-01-24T12:42:58.177 INFO:teuthology.orchestra.run.smithi027.stdout:creating configuration files ... ok 2024-01-24T12:42:58.299 INFO:teuthology.orchestra.run.smithi027.stdout:running bootstrap script ... ok 2024-01-24T12:42:58.793 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-24T12:42:58.983 INFO:teuthology.orchestra.run.smithi027.stdout:performing post-bootstrap initialization ... ok 2024-01-24T12:42:59.268 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-24T12:42:59.609 INFO:teuthology.orchestra.run.smithi195.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-24T12:42:59.627 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:This user must also own the server process. 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:The database cluster will be initialized with locale "en_US". 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:The default text search configuration will be set to "english". 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:Data page checksums are disabled. 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:42:59.681 INFO:teuthology.orchestra.run.smithi195.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-24T12:42:59.682 INFO:teuthology.orchestra.run.smithi195.stdout:creating subdirectories ... ok 2024-01-24T12:42:59.682 INFO:teuthology.orchestra.run.smithi195.stdout:selecting dynamic shared memory implementation ... posix 2024-01-24T12:42:59.689 INFO:teuthology.orchestra.run.smithi027.stdout:syncing data to disk ... ok 2024-01-24T12:42:59.705 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default max_connections ... 100 2024-01-24T12:42:59.738 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default shared_buffers ... 128MB 2024-01-24T12:42:59.752 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default time zone ... Etc/UTC 2024-01-24T12:42:59.753 INFO:teuthology.orchestra.run.smithi195.stdout:creating configuration files ... ok 2024-01-24T12:42:59.918 INFO:teuthology.orchestra.run.smithi195.stdout:running bootstrap script ... ok 2024-01-24T12:42:59.962 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:00.088 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-24T12:43:00.132 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-24T12:43:00.215 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up postgresql (14+238) ... 2024-01-24T12:43:00.341 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:00.467 INFO:teuthology.orchestra.run.smithi124.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:43:00.551 INFO:teuthology.orchestra.run.smithi195.stdout:performing post-bootstrap initialization ... ok 2024-01-24T12:43:00.725 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:00.725 INFO:teuthology.orchestra.run.smithi124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:01.099 INFO:teuthology.orchestra.run.smithi195.stdout:syncing data to disk ... ok 2024-01-24T12:43:01.378 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-24T12:43:01.604 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-24T12:43:01.688 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:43:01.848 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:43:02.994 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:03.119 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-24T12:43:03.177 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T12:43:03.245 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql (14+238) ... 2024-01-24T12:43:03.298 INFO:teuthology.orchestra.run.smithi124.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T12:43:03.371 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:03.497 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:43:03.767 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:03.767 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:04.379 INFO:teuthology.orchestra.run.smithi124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:43:04.385 DEBUG:teuthology.parallel:result is None 2024-01-24T12:43:04.392 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-24T12:43:04.634 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:04.727 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:43:04.735 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-24T12:43:04.852 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql (14+238) ... 2024-01-24T12:43:04.895 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:43:04.978 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-24T12:43:05.138 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-24T12:43:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-24T12:43:06.115 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-24T12:43:06.459 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:43:06.594 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:43:06.973 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T12:43:07.082 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T12:43:07.728 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:43:07.733 DEBUG:teuthology.parallel:result is None 2024-01-24T12:43:07.955 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T12:43:08.088 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T12:43:08.740 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-24T12:43:08.747 DEBUG:teuthology.parallel:result is None 2024-01-24T12:43:08.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:43:08.900 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2024-01-24T12:43:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:08.921 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:08.921 INFO:teuthology.task.install:The correct ceph version 18.2.1-341-g4e3182a6-1jammy is installed. 2024-01-24T12:43:08.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:43:09.160 DEBUG:teuthology.orchestra.run.smithi124:> dpkg-query -W -f '${Version}' ceph 2024-01-24T12:43:09.180 INFO:teuthology.orchestra.run.smithi124.stdout:18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:09.180 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:09.181 INFO:teuthology.task.install:The correct ceph version 18.2.1-341-g4e3182a6-1jammy is installed. 2024-01-24T12:43:09.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T12:43:09.423 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2024-01-24T12:43:09.445 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:09.446 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341-g4e3182a6-1jammy 2024-01-24T12:43:09.446 INFO:teuthology.task.install:The correct ceph version 18.2.1-341-g4e3182a6-1jammy is installed. 2024-01-24T12:43:09.448 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-24T12:43:09.448 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:09.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T12:43:09.463 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:09.464 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T12:43:09.479 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:09.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T12:43:09.508 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-24T12:43:09.509 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:09.509 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T12:43:09.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T12:43:09.578 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:09.579 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T12:43:09.593 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T12:43:09.647 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:09.647 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T12:43:09.668 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T12:43:09.728 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-24T12:43:09.728 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:09.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T12:43:09.742 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T12:43:09.798 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:09.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T12:43:09.812 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T12:43:09.868 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:09.868 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T12:43:09.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T12:43:09.956 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-24T12:43:09.956 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:09.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T12:43:09.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T12:43:10.027 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:10.027 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T12:43:10.041 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T12:43:10.095 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:10.096 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T12:43:10.117 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T12:43:10.184 INFO:teuthology.run_tasks:Running task ceph... 2024-01-24T12:43:10.248 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-24T12:43:10.248 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2024-01-24T12:43:10.250 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 777 /var/log/ceph 2024-01-24T12:43:10.253 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-01-24T12:43:10.272 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-24T12:43:10.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-24T12:43:10.307 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-24T12:43:10.309 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-24T12:43:10.339 INFO:tasks.ceph:Creating extra log directories... 2024-01-24T12:43:10.339 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-24T12:43:10.363 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-24T12:43:10.365 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-24T12:43:10.406 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-24T12:43:10.407 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-24T12:43:10.407 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-24T12:43:10.407 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:10.407 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-24T12:43:10.422 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:10.502 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:10.502 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-24T12:43:10.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:10.583 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:10.583 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-24T12:43:10.592 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:10.689 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-24T12:43:10.689 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-24T12:43:10.689 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7530766', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 4668, 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'sleep_before_teardown': 0, 'subset': '346/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb31wdFe43Aa1vv7AEA/QSS11EbYkPsRg6DNznaQFtnvf/bWnxCrBiTddAC0G+za/PQ04nzCVHVUNNraA5qS2s=', 'smithi124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBYZXbSRKtQbZIY8FOmZayvljdcrmTZ7kaFekOw3RtcO4qEoNCzhffAzxhdj5acEknJks6DwIhW0qI+XZI+Z1A=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPTmx7D2773Re/JDDuKb7FpIvc3l3oC1VzTSxIXrngDhgF2fmGOLFnXOiuZTOp4ZZ2WyxeAXw3wz8LHItMATaM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-24_12:12:30', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-24T12:43:10.690 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-24T12:43:10.692 DEBUG:teuthology.orchestra.run.smithi124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-24T12:43:10.695 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-24T12:43:10.703 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2024-01-24T12:43:10.739 DEBUG:teuthology.orchestra.run.smithi124:> sudo install -d -m0777 -- /var/run/ceph 2024-01-24T12:43:10.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-01-24T12:43:10.763 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:10.764 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T12:43:10.798 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T12:43:10.798 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-01-24T12:43:10.846 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-24 12:36:42.972148833 +0000 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-24 12:36:42.700159967 +0000 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-24 12:36:42.700159967 +0000 2024-01-24T12:43:10.847 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-01-24T12:43:10.847 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T12:43:10.901 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-24T12:43:10.901 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-24T12:43:10.901 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000508972 s, 1.0 MB/s 2024-01-24T12:43:10.902 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T12:43:10.952 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-01-24T12:43:10.998 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T12:43:10.998 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-24 12:36:43.468129467 +0000 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-24 12:36:43.216139277 +0000 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-24 12:36:43.216139277 +0000 2024-01-24T12:43:10.999 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-01-24T12:43:10.999 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T12:43:11.057 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-24T12:43:11.058 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-24T12:43:11.058 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00055209 s, 927 kB/s 2024-01-24T12:43:11.059 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T12:43:11.108 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-24 12:36:44.000108754 +0000 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-24 12:36:43.724119500 +0000 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-24 12:36:43.724119500 +0000 2024-01-24T12:43:11.155 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-01-24T12:43:11.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T12:43:11.210 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-24T12:43:11.210 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-24T12:43:11.210 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000481703 s, 1.1 MB/s 2024-01-24T12:43:11.211 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T12:43:11.260 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-01-24T12:43:11.306 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T12:43:11.306 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.306 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-01-24T12:43:11.306 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.307 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-24 12:36:44.520088509 +0000 2024-01-24T12:43:11.307 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-24 12:36:44.244099255 +0000 2024-01-24T12:43:11.307 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-24 12:36:44.244099255 +0000 2024-01-24T12:43:11.307 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-01-24T12:43:11.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T12:43:11.361 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-24T12:43:11.361 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-24T12:43:11.362 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000510396 s, 1.0 MB/s 2024-01-24T12:43:11.362 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T12:43:11.412 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:11.412 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:11.412 DEBUG:teuthology.orchestra.run.smithi124:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T12:43:11.418 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T12:43:11.418 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_1 2024-01-24T12:43:11.465 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T12:43:11.465 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-01-24T12:43:11.465 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-24 12:36:40.602145552 +0000 2024-01-24T12:43:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-24 12:36:40.342147874 +0000 2024-01-24T12:43:11.466 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-24 12:36:40.342147874 +0000 2024-01-24T12:43:11.466 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2024-01-24T12:43:11.466 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T12:43:11.519 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-24T12:43:11.520 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-24T12:43:11.520 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000635509 s, 806 kB/s 2024-01-24T12:43:11.521 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T12:43:11.571 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_2 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-24 12:36:41.130140837 +0000 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-24 12:36:40.858143266 +0000 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-24 12:36:40.858143266 +0000 2024-01-24T12:43:11.617 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2024-01-24T12:43:11.618 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T12:43:11.671 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-24T12:43:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-24T12:43:11.672 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000551536 s, 928 kB/s 2024-01-24T12:43:11.673 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T12:43:11.727 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_3 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-24 12:36:41.642136263 +0000 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-24 12:36:41.374138657 +0000 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-24 12:36:41.374138657 +0000 2024-01-24T12:43:11.773 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2024-01-24T12:43:11.774 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T12:43:11.827 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-24T12:43:11.827 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-24T12:43:11.827 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.00049643 s, 1.0 MB/s 2024-01-24T12:43:11.828 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T12:43:11.882 DEBUG:teuthology.orchestra.run.smithi124:> stat /dev/vg_nvme/lv_4 2024-01-24T12:43:11.928 INFO:teuthology.orchestra.run.smithi124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:Access: 2024-01-24 12:36:41.886134083 +0000 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:Modify: 2024-01-24 12:36:41.882134119 +0000 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout:Change: 2024-01-24 12:36:41.882134119 +0000 2024-01-24T12:43:11.929 INFO:teuthology.orchestra.run.smithi124.stdout: Birth: - 2024-01-24T12:43:11.929 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T12:43:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records in 2024-01-24T12:43:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:1+0 records out 2024-01-24T12:43:11.983 INFO:teuthology.orchestra.run.smithi124.stderr:512 bytes copied, 0.000542825 s, 943 kB/s 2024-01-24T12:43:11.984 DEBUG:teuthology.orchestra.run.smithi124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T12:43:12.034 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:12.034 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-24T12:43:12.034 INFO:tasks.ceph:Generating config... 2024-01-24T12:43:12.036 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-24T12:43:12.036 INFO:tasks.ceph:[client] debug client = 20 2024-01-24T12:43:12.036 INFO:tasks.ceph:[client] debug ms = 1 2024-01-24T12:43:12.036 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-24T12:43:12.036 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-24T12:43:12.036 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-24T12:43:12.036 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-24T12:43:12.037 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-24T12:43:12.037 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-24T12:43:12.038 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-24T12:43:12.038 INFO:tasks.ceph:Setting up mon.a... 2024-01-24T12:43:12.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-24T12:43:12.074 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2024-01-24T12:43:12.095 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-24T12:43:12.173 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T12:43:12.226 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27'), ('mon.b', '172.21.15.124'), ('mon.c', '[v2:172.21.15.124:3301,v1:172.21.15.124:6790]')] 2024-01-24T12:43:12.226 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-24T12:43:12.227 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:12.227 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-24T12:43:12.274 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --add b 172.21.15.124 --addv c '[v2:172.21.15.124:3301,v1:172.21.15.124:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:12.360 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:12.360 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98 2024-01-24T12:43:12.360 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = pacific 2024-01-24T12:43:12.360 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:fsid c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2024-01-24T12:43:12.362989+0000 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-01-24T12:43:12.362989+0000 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 16 (pacific) 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:1: [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] mon.b 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:2: [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] mon.c 2024-01-24T12:43:12.361 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-24T12:43:12.362 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-24T12:43:12.410 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98... 2024-01-24T12:43:12.411 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-24T12:43:12.455 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-24T12:43:12.458 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-24T12:43:12.484 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-01-24T12:43:12.484 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2024-01-24T12:43:12.484 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-24T12:43:12.484 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2024-01-24T12:43:12.484 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2024-01-24T12:43:12.485 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-24T12:43:12.486 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-24T12:43:12.487 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.488 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.27,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn min per osd = 0 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2024-01-24T12:43:12.489 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2024-01-24T12:43:12.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2024-01-24T12:43:12.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2024-01-24T12:43:12.492 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2024-01-24T12:43:12.493 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.494 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.495 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2024-01-24T12:43:12.496 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2024-01-24T12:43:12.497 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.498 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds balancer = 20 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-24T12:43:12.499 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.500 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.502 INFO:teuthology.orchestra.run.smithi124.stdout:[global] 2024-01-24T12:43:12.502 INFO:teuthology.orchestra.run.smithi124.stdout: chdir = "" 2024-01-24T12:43:12.502 INFO:teuthology.orchestra.run.smithi124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-24T12:43:12.502 INFO:teuthology.orchestra.run.smithi124.stdout: auth supported = cephx 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: filestore xattr use omap = true 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: mon clock drift allowed = 1.000 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: osd crush chooseleaf type = 0 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: auth debug = true 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.503 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on old message = true 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: ms die on bug = true 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn max object skew = 0 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: # disable pg_autoscaler by default for new pools 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default size = 2 2024-01-24T12:43:12.504 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow primary affinity = true 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd allow pg remap = true 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on legacy crush tunables = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on crush straw calc version zero = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on no sortbitwise = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on osd down out interval zero = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon warn on too few osds = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-24T12:43:12.505 INFO:teuthology.orchestra.run.smithi124.stdout: mon_allow_pool_size_one = true 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: osd default data pool replay window = 5 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: mon allow pool delete = true 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.506 INFO:teuthology.orchestra.run.smithi124.stdout: mon cluster log file level = debug 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: debug asserts on shutdown = true 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: mon health detail to clog = false 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: mon host = "172.21.15.27,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: mon pg warn min per osd = 0 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: fsid = c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout:[osd] 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: osd journal size = 100 2024-01-24T12:43:12.507 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub load threshold = 5.0 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd scrub max interval = 600 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd mclock profile = high_recovery_ops 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd recover clone overlap = true 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd recovery max chunk = 1048576 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug shutdown = true 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug op order = true 2024-01-24T12:43:12.508 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug verify stray on activate = true 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: osd open classes on start = true 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug pg log writeout = true 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: osd deep scrub update digest min age = 30 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: osd map max advance = 10 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.509 INFO:teuthology.orchestra.run.smithi124.stdout: journal zero on create = true 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: filestore ondisk finisher threads = 3 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: filestore apply finisher threads = 3 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: bdev debug aio = true 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: osd debug misdirected ops = true 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: bdev async discard = True 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: bdev enable discard = True 2024-01-24T12:43:12.510 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore allocator = bitmap 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore block size = 96636764160 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: bluestore fsck on mount = True 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluefs = 1/20 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: debug bluestore = 1/20 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: debug osd = 20 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: debug rocksdb = 4/10 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd backfillfull_ratio = 0.85 2024-01-24T12:43:12.511 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd full ratio = 0.9 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd nearfull ratio = 0.8 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: osd failsafe full ratio = 0.95 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: osd objectstore = bluestore 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr] 2024-01-24T12:43:12.512 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: debug mgr = 20 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: mgr/telemetry/nag = false 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout:[mon] 2024-01-24T12:43:12.513 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: debug mon = 20 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: debug paxos = 20 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: debug auth = 20 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon data avail warn = 5 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon mgr mkfs grace = 240 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd reporter subtree level = osd 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon osd prime pg temp = true 2024-01-24T12:43:12.514 INFO:teuthology.orchestra.run.smithi124.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: auth mon ticket ttl = 660 # 11m 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: auth service ticket ttl = 240 # 4m 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: # don't complain about insecure global_id in the test suite 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.515 INFO:teuthology.orchestra.run.smithi124.stdout: # 1m isn't quite enough 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: mon_down_mkfs_grace = 2m 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: mon_warn_on_filestore_osds = false 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: mon op complaint time = 120 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout:[client] 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: rgw cache enabled = true 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable ops log = true 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: rgw enable usage log = true 2024-01-24T12:43:12.516 INFO:teuthology.orchestra.run.smithi124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: client mount timeout = 600 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: debug client = 20 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.a] 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.b] 2024-01-24T12:43:12.517 INFO:teuthology.orchestra.run.smithi124.stdout:[mon.c] 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout:[mds] 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds = 20 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout: debug mds balancer = 20 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout: debug ms = 1 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug frag = True 2024-01-24T12:43:12.518 INFO:teuthology.orchestra.run.smithi124.stdout: mds debug scatterstat = True 2024-01-24T12:43:12.519 INFO:teuthology.orchestra.run.smithi124.stdout: mds op complaint time = 180 2024-01-24T12:43:12.519 INFO:teuthology.orchestra.run.smithi124.stdout: mds verify scatter = True 2024-01-24T12:43:12.519 INFO:teuthology.orchestra.run.smithi124.stdout: osd op complaint time = 180 2024-01-24T12:43:12.519 INFO:teuthology.orchestra.run.smithi124.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.519 INFO:teuthology.orchestra.run.smithi124.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-01-24T12:43:12.520 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-24T12:43:12.521 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-01-24T12:43:12.522 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-01-24T12:43:12.523 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.27,172.21.15.124,[v2:172.21.15.124:3301,v1:172.21.15.124:6790]" 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn min per osd = 0 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-01-24T12:43:12.524 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-01-24T12:43:12.525 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-01-24T12:43:12.526 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-01-24T12:43:12.527 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.528 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-01-24T12:43:12.529 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-01-24T12:43:12.530 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-01-24T12:43:12.531 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-01-24T12:43:12.532 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-24T12:43:12.532 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-24T12:43:12.594 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-24T12:43:12.595 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:12.595 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-24T12:43:12.600 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:12.600 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-24T12:43:12.648 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:43:12.648 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:12.648 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-24T12:43:12.648 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T12:43:12.710 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:12.710 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:12.759 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:43:12.759 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:12.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-24T12:43:12.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T12:43:12.781 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:12.781 DEBUG:teuthology.orchestra.run.smithi124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:12.830 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-01-24T12:43:12.830 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:12.830 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-24T12:43:12.830 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-24T12:43:12.865 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:12.865 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:12.917 INFO:tasks.ceph:Setting up mon nodes... 2024-01-24T12:43:12.917 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-24T12:43:12.917 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-24T12:43:12.961 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-24T12:43:12.963 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-24T12:43:13.006 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-24T12:43:13.024 INFO:tasks.ceph:Setting up mds nodes... 2024-01-24T12:43:13.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-24T12:43:13.065 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-24T12:43:13.068 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-24T12:43:13.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-24T12:43:13.210 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-24T12:43:13.213 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-24T12:43:13.266 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-24T12:43:13.309 INFO:teuthology.orchestra.run.smithi124.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-24T12:43:13.312 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-24T12:43:13.368 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-24T12:43:13.368 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-24T12:43:13.412 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-24T12:43:13.442 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-24T12:43:13.443 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi124.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-24T12:43:13.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-24T12:43:13.458 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:13.458 INFO:tasks.ceph:role: osd.0 2024-01-24T12:43:13.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:43:13.458 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:13.523 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:13.990 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-24T12:43:13.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-24T12:43:13.992 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-24T12:43:14.084 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-24T12:43:14.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:14.094 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:14.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-24T12:43:14.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:14.150 INFO:tasks.ceph:role: osd.1 2024-01-24T12:43:14.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:43:14.150 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:14.681 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-24T12:43:14.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-24T12:43:14.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-24T12:43:14.843 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-24T12:43:14.854 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:14.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:14.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-24T12:43:14.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:14.914 INFO:tasks.ceph:role: osd.2 2024-01-24T12:43:14.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:43:14.914 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:14.979 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:15.450 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-24T12:43:15.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-24T12:43:15.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-24T12:43:15.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-24T12:43:15.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:15.616 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:15.617 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-24T12:43:15.669 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:15.669 INFO:tasks.ceph:role: osd.3 2024-01-24T12:43:15.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T12:43:15.669 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-24T12:43:15.734 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:15.734 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:15.735 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:16.159 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-24T12:43:16.161 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-24T12:43:16.161 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-24T12:43:16.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-24T12:43:16.264 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:16.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:16.265 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:16.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.366+0000 7eff90cd5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-24T12:43:16.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.366+0000 7eff90cd5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-24T12:43:16.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.366+0000 7eff90cd5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T12:43:16.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.366+0000 7eff90cd5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T12:43:16.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.366+0000 7eff90cd5640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-24T12:43:16.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:16.370+0000 7eff90cd5640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-24T12:43:19.396 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-24T12:43:19.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:19.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-24T12:43:19.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-24T12:43:19.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T12:43:19.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T12:43:19.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-24T12:43:19.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:19.494+0000 7f0cf0acd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-24T12:43:22.532 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-24T12:43:22.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:22.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-24T12:43:22.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-24T12:43:22.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T12:43:22.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T12:43:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-24T12:43:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:22.670+0000 7f8fb7c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-24T12:43:25.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-24T12:43:25.787 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:25.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-24T12:43:25.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-24T12:43:25.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T12:43:25.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T12:43:25.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-24T12:43:25.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:25.870+0000 7fd62a4a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-24T12:43:28.876 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-24T12:43:28.930 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-24T12:43:28.945 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:28.945 INFO:tasks.ceph:role: osd.4 2024-01-24T12:43:28.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:43:28.945 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-24T12:43:29.009 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:29.010 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:29.473 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-24T12:43:29.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-24T12:43:29.475 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-24T12:43:29.627 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-24T12:43:29.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:29.639 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:29.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-24T12:43:29.692 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:29.692 INFO:tasks.ceph:role: osd.5 2024-01-24T12:43:29.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:43:29.692 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:29.756 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:29.757 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:29.757 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:29.757 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:29.757 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:30.197 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-24T12:43:30.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-24T12:43:30.199 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-24T12:43:30.260 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-24T12:43:30.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:30.317 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:30.317 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-24T12:43:30.372 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:30.373 INFO:tasks.ceph:role: osd.6 2024-01-24T12:43:30.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:43:30.373 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:30.436 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:30.902 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-24T12:43:30.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-24T12:43:30.905 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-24T12:43:31.004 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-24T12:43:31.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:31.014 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:31.014 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-24T12:43:31.067 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-24T12:43:31.067 INFO:tasks.ceph:role: osd.7 2024-01-24T12:43:31.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T12:43:31.068 DEBUG:teuthology.orchestra.run.smithi124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout: = sunit=0 swidth=0 blks 2024-01-24T12:43:31.130 INFO:teuthology.orchestra.run.smithi124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-24T12:43:31.131 INFO:teuthology.orchestra.run.smithi124.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-24T12:43:31.131 INFO:teuthology.orchestra.run.smithi124.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-24T12:43:31.131 INFO:teuthology.orchestra.run.smithi124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-24T12:43:31.612 INFO:teuthology.orchestra.run.smithi124.stdout:Discarding blocks...Done. 2024-01-24T12:43:31.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi124.front.sepia.ceph.com -o noatime 2024-01-24T12:43:31.614 DEBUG:teuthology.orchestra.run.smithi124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-24T12:43:31.741 DEBUG:teuthology.orchestra.run.smithi124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-24T12:43:31.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:43:31.751 INFO:teuthology.orchestra.run.smithi124.stderr:sudo: /sbin/restorecon: command not found 2024-01-24T12:43:31.752 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:31.871 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.868+0000 7fd98466b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-24T12:43:31.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.872+0000 7fd98466b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-24T12:43:31.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.872+0000 7fd98466b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T12:43:31.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.872+0000 7fd98466b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T12:43:31.873 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.872+0000 7fd98466b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-24T12:43:31.878 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:31.876+0000 7fd98466b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-24T12:43:34.861 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-24T12:43:34.874 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:34.954 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-24T12:43:34.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-24T12:43:34.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T12:43:34.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T12:43:34.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-24T12:43:34.955 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:34.952+0000 7f12ce4d8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-24T12:43:37.959 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-24T12:43:38.013 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:38.095 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.092+0000 7f8831fd0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-24T12:43:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.096+0000 7f8831fd0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-24T12:43:38.096 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.096+0000 7f8831fd0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T12:43:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.096+0000 7f8831fd0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T12:43:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.096+0000 7f8831fd0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-24T12:43:38.097 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:38.096+0000 7f8831fd0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-24T12:43:40.691 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:40.694 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:40.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:43:41.115 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-24T12:43:41.128 DEBUG:teuthology.orchestra.run.smithi124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:41.210 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-24T12:43:41.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-24T12:43:41.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T12:43:41.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T12:43:41.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-24T12:43:41.211 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:41.208+0000 7fc756f0a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-24T12:43:44.217 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-24T12:43:44.272 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-24T12:43:44.272 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-24T12:43:44.286 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.286 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-24T12:43:44.346 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-24T12:43:44.405 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.405 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-24T12:43:44.461 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-24T12:43:44.517 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.517 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-24T12:43:44.573 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:44.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-24T12:43:44.625 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.625 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-24T12:43:44.639 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-24T12:43:44.695 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.696 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-24T12:43:44.751 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.751 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-24T12:43:44.804 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.804 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-24T12:43:44.860 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:44.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-24T12:43:44.916 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:43:44.916 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-24T12:43:44.925 INFO:tasks.ceph:Adding keys to all mons... 2024-01-24T12:43:44.925 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-24T12:43:44.928 DEBUG:teuthology.orchestra.run.smithi124:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDgBbFlM01vORAAMqmaAtMVy8lUFjfY8ZNzXw== 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDhBbFlQZcTBBAAYZILl9PBM3z6f7Dlx2L6WA== 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDhBbFlyK6vDBAAvKiUTuCXvZil5TCnB5fK3w== 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDkBbFlbJT6FRAAEIkxf3AhyUYTa8joJLLDzA== 2024-01-24T12:43:44.966 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDnBbFlC5eoHRAAaIKC5wNyh4qiMb/0NaveLA== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDqBbFlF2c5KBAAKtOF4Th9I8UNvUGAWK7Pmg== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDtBbFlps0WNBAAAQbOiymfE7S6UZ1H7EhGWg== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDhBbFlkNOKABAACDOB7fH6+W0UzA4iGeGz6g== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDhBbFlpZGZEhAAkbqCbeNGG8Mg+spl0vIeRA== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDzBbFlPkAQNBAAXU7Vs5esWpZVQuay5eux8w== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD2BbFljk0GORAAtUQKBYpFTX77NcK2tmko8g== 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2024-01-24T12:43:44.967 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD6BbFlJsrbBRAAchLB753r6TDf7cIbQB0oiQ== 2024-01-24T12:43:44.968 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2024-01-24T12:43:44.968 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQD9BbFlmAy1DBAA/o2LjJklZhyV4sq/aMzOMA== 2024-01-24T12:43:44.968 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-01-24T12:43:44.968 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDhBbFleEe5GBAAqDGgirWGSWyzxSV0GgZeCQ== 2024-01-24T12:43:44.973 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.y] 2024-01-24T12:43:44.973 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDgBbFlM01vORAAMqmaAtMVy8lUFjfY8ZNzXw== 2024-01-24T12:43:44.973 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.a] 2024-01-24T12:43:44.973 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDhBbFlQZcTBBAAYZILl9PBM3z6f7Dlx2L6WA== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.c] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDhBbFlyK6vDBAAvKiUTuCXvZil5TCnB5fK3w== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.0] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDkBbFlbJT6FRAAEIkxf3AhyUYTa8joJLLDzA== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.1] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDnBbFlC5eoHRAAaIKC5wNyh4qiMb/0NaveLA== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.2] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDqBbFlF2c5KBAAKtOF4Th9I8UNvUGAWK7Pmg== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.3] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDtBbFlps0WNBAAAQbOiymfE7S6UZ1H7EhGWg== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[mgr.x] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDhBbFlkNOKABAACDOB7fH6+W0UzA4iGeGz6g== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[mds.b] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDhBbFlpZGZEhAAkbqCbeNGG8Mg+spl0vIeRA== 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.4] 2024-01-24T12:43:44.974 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDzBbFlPkAQNBAAXU7Vs5esWpZVQuay5eux8w== 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.5] 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQD2BbFljk0GORAAtUQKBYpFTX77NcK2tmko8g== 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.6] 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQD6BbFlJsrbBRAAchLB753r6TDf7cIbQB0oiQ== 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout:[osd.7] 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQD9BbFlmAy1DBAA/o2LjJklZhyV4sq/aMzOMA== 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout:[client.0] 2024-01-24T12:43:44.975 INFO:teuthology.orchestra.run.smithi124.stdout: key = AQDhBbFleEe5GBAAqDGgirWGSWyzxSV0GgZeCQ== 2024-01-24T12:43:44.976 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T12:43:45.015 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T12:43:45.065 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.068 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.280 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.283 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.370 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.451 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.453 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.535 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T12:43:45.539 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-24T12:43:45.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.625 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-24T12:43:45.711 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.754 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.798 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.843 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.883 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:45.967 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-24T12:43:46.010 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T12:43:46.051 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-24T12:43:46.098 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-24T12:43:46.098 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-24T12:43:46.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T12:43:46.253 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-24T12:43:46.265 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-24T12:43:46.278 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T12:43:46.375 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-24T12:43:46.385 DEBUG:teuthology.orchestra.run.smithi124:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-24T12:43:46.438 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-24T12:43:46.533 DEBUG:teuthology.orchestra.run.smithi124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-24T12:43:46.543 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:46.545 DEBUG:teuthology.orchestra.run.smithi124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-24T12:43:46.588 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-24T12:43:46.588 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-24T12:43:46.588 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-24T12:43:46.594 INFO:tasks.ceph.mon.a:Started 2024-01-24T12:43:46.594 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-24T12:43:46.595 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-24T12:43:46.633 INFO:tasks.ceph.mon.b:Started 2024-01-24T12:43:46.633 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-24T12:43:46.633 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-24T12:43:46.635 INFO:tasks.ceph.mon.c:Started 2024-01-24T12:43:46.635 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-24T12:43:46.635 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-24T12:43:46.636 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-24T12:43:46.638 INFO:tasks.ceph.mgr.y:Started 2024-01-24T12:43:46.638 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-24T12:43:46.638 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-24T12:43:46.640 INFO:tasks.ceph.mgr.x:Started 2024-01-24T12:43:46.640 INFO:tasks.ceph:Setting crush tunables to default 2024-01-24T12:43:46.641 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2024-01-24T12:43:46.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 Processor -- start 2024-01-24T12:43:46.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 -- start start 2024-01-24T12:43:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec070180 con 0x7f26ec069f80 2024-01-24T12:43:46.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0b82e0 con 0x7f26ec14dea0 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f2f9a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec070380 con 0x7f26ec0b8770 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33790/0 (socket says 172.21.15.27:33790) 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 -- 172.21.15.27:0/4257663216 learned_addr learned my addr 172.21.15.27:0/4257663216 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 msgr2=0x7f26ec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 msgr2=0x7f26ec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26ebfff640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 msgr2=0x7f26ec06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26ebfff640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 msgr2=0x7f26ec06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T12:43:46.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-24T12:43:46.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.757+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f0d36640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 msgr2=0x7f26ec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f0d36640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 msgr2=0x7f26ec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26ebfff640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 msgr2=0x7f26ec06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-24T12:43:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26ebfff640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 msgr2=0x7f26ec06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-24T12:43:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T12:43:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T12:43:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:46.961+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T12:43:47.252 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:47.249+0000 7f1fbd03c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T12:43:47.325 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:47.324+0000 7fd7c623f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f0d36640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26ebfff640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 msgr2=0x7f26ec06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 msgr2=0x7f26ec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.365+0000 7f26f1537640 1 -- 172.21.15.27:0/4257663216 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec070660 con 0x7f26ec0b8770 2024-01-24T12:43:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f1537640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b9400 tx=0x7f26dc01f7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cbd487fead1369a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26eb7fe640 1 -- 172.21.15.27:0/4257663216 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0ae650 con 0x7f26ec0b8770 2024-01-24T12:43:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26eb7fe640 1 -- 172.21.15.27:0/4257663216 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc0ae7b0 con 0x7f26ec0b8770 2024-01-24T12:43:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26eb7fe640 1 -- 172.21.15.27:0/4257663216 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0aeba0 con 0x7f26ec0b8770 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 -- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b9400 tx=0x7f26dc01f7c0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 -- 172.21.15.27:0/4257663216 shutdown_connections 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.124:3300/0 conn(0x7f26ec14dea0 0x7f26ec06fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/4257663216 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec0b8770 0x7f26ec1447d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/4257663216 >> v2:172.21.15.27:3300/0 conn(0x7f26ec069f80 0x7f26ec0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 -- 172.21.15.27:0/4257663216 >> 172.21.15.27:0/4257663216 conn(0x7f26ec0bcf70 msgr2=0x7f26ec0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 -- 172.21.15.27:0/4257663216 shutdown_connections 2024-01-24T12:43:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.369+0000 7f26f2f9a640 1 -- 172.21.15.27:0/4257663216 wait complete. 2024-01-24T12:43:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 Processor -- start 2024-01-24T12:43:47.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- start start 2024-01-24T12:43:47.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26ec069f80 0x7f26ec0bc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec14dea0 0x7f26ec139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0bca60 con 0x7f26ec0b8770 2024-01-24T12:43:47.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec148150 con 0x7f26ec069f80 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec145490 con 0x7f26ec14dea0 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33830/0 (socket says 172.21.15.27:33830) 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 -- 172.21.15.27:0/1743676852 learned_addr learned my addr 172.21.15.27:0/1743676852 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f1537640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec14dea0 0x7f26ec139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f0d36640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26ec069f80 0x7f26ec0bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 -- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec14dea0 msgr2=0x7f26ec139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec14dea0 0x7f26ec139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 -- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26ec069f80 msgr2=0x7f26ec0bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26ec069f80 0x7f26ec0bc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 -- 172.21.15.27:0/1743676852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009640 con 0x7f26ec0b8770 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26ebfff640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26e00128e0 tx=0x7f26e0012da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:47.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00109e0 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000c040 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0010d40 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec145770 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec142360 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f26e001e710 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f26e0015940 con 0x7f26ec0b8770 2024-01-24T12:43:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.373+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec04e000 con 0x7f26ec0b8770 2024-01-24T12:43:47.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.377+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f26e0023060 con 0x7f26ec0b8770 2024-01-24T12:43:47.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.441+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f26ec13aaf0 con 0x7f26ec0b8770 2024-01-24T12:43:47.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26e97fa640 1 -- 172.21.15.27:0/1743676852 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f26e0019030 con 0x7f26ec0b8770 2024-01-24T12:43:47.447 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 msgr2=0x7f26ec1e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26e00128e0 tx=0x7f26e0012da0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 shutdown_connections 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26ec14dea0 0x7f26ec139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26ec0b8770 0x7f26ec1e3260 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 --2- 172.21.15.27:0/1743676852 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26ec069f80 0x7f26ec0bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 >> 172.21.15.27:0/1743676852 conn(0x7f26ec0bcf70 msgr2=0x7f26ec13fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 shutdown_connections 2024-01-24T12:43:47.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:47.445+0000 7f26f2f9a640 1 -- 172.21.15.27:0/1743676852 wait complete. 2024-01-24T12:43:47.466 INFO:tasks.ceph:check_enable_crimson: False 2024-01-24T12:43:47.466 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-24T12:43:47.466 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:47.466 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-24T12:43:47.477 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:47.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-24T12:43:47.531 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:47.531 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-24T12:43:47.582 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-24T12:43:47.583 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-24T12:43:47.634 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:47.634 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-24T12:43:47.648 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:47.648 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-24T12:43:47.703 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:47.704 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-24T12:43:47.728 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:47.725+0000 7f1fbd03c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T12:43:47.759 DEBUG:teuthology.orchestra.run.smithi124:> set -ex 2024-01-24T12:43:47.759 DEBUG:teuthology.orchestra.run.smithi124:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-24T12:43:47.811 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4 0 2024-01-24T12:43:47.817 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:47.816+0000 7fd7c623f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T12:43:47.931 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:47.929+0000 7f1fbd03c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T12:43:47.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 Processor -- start 2024-01-24T12:43:47.938 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 -- start start 2024-01-24T12:43:47.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.939 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c06fc40 con 0x7fdf2c147640 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c06ff20 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf330bb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0706d0 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35286/0 (socket says 172.21.15.124:35286) 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 -- 172.21.15.124:0/1931744878 learned_addr learned my addr 172.21.15.124:0/1931744878 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 -- 172.21.15.124:0/1931744878 >> v1:172.21.15.124:6789/0 conn(0x7fdf2c0b3dd0 legacy=0x7fdf2c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 -- 172.21.15.124:0/1931744878 >> v1:172.21.15.27:6789/0 conn(0x7fdf2c147640 legacy=0x7fdf2c1414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:47.940 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.936+0000 7fdf30e57640 1 -- 172.21.15.124:0/1931744878 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c070200 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf30e57640 1 --2- 172.21.15.124:0/1931744878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e80 tx=0x7fdf2401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1593dda8672ba3fe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:47.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf2b7fe640 1 -- 172.21.15.124:0/1931744878 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a57a0 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf2b7fe640 1 -- 172.21.15.124:0/1931744878 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240a5900 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.942 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf2b7fe640 1 -- 172.21.15.124:0/1931744878 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a5c90 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 -- 172.21.15.124:0/1931744878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 msgr2=0x7fdf2c0b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 --2- 172.21.15.124:0/1931744878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e80 tx=0x7fdf2401c9f0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 -- 172.21.15.124:0/1931744878 shutdown_connections 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 --2- 172.21.15.124:0/1931744878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c0b81b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 -- 172.21.15.124:0/1931744878 >> 172.21.15.124:0/1931744878 conn(0x7fdf2c0bcf70 msgr2=0x7fdf2c0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 -- 172.21.15.124:0/1931744878 shutdown_connections 2024-01-24T12:43:47.943 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 -- 172.21.15.124:0/1931744878 wait complete. 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.940+0000 7fdf330bb640 1 Processor -- start 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- start start 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c1e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 0x7fdf2c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c06a4c0 con 0x7fdf2c141f70 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c143070 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c1e4080 con 0x7fdf2c0b9b50 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.946 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c1e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60196/0 (socket says 172.21.15.124:60196) 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 -- 172.21.15.124:0/872228887 learned_addr learned my addr 172.21.15.124:0/872228887 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf31658640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 0x7fdf2c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 -- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 msgr2=0x7fdf2c1e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c1e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 -- 172.21.15.124:0/872228887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 msgr2=0x7fdf2c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 0x7fdf2c069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 -- 172.21.15.124:0/872228887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24009b30 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf31658640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 0x7fdf2c069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf2bfff640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c1e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf30e57640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf240af040 tx=0x7fdf24019790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240b8670 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.947 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240b87d0 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0bcc20 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240b8b60 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c1e4620 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf240c3460 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdf240b65c0 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.948 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.944+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c0b86f0 con 0x7fdf2c0b3dd0 2024-01-24T12:43:47.968 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:47.968+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fdf240c38b0 con 0x7fdf2c0b3dd0 2024-01-24T12:43:48.036 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.036+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4", "id": 0} v 0) v1 -- 0x7fdf2c0b86f0 con 0x7fdf2c0b3dd0 2024-01-24T12:43:48.048 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf297fa640 1 -- 172.21.15.124:0/872228887 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf240c3b80 con 0x7fdf2c0b3dd0 2024-01-24T12:43:48.048 INFO:teuthology.orchestra.run.smithi124.stdout:0 2024-01-24T12:43:48.049 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 msgr2=0x7fdf2c0bae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf240af040 tx=0x7fdf24019790 comp rx=0 tx=0).stop 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 shutdown_connections 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf2c141f70 0x7fdf2c069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf2c0b9b50 0x7fdf2c1e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 --2- 172.21.15.124:0/872228887 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf2c0b3dd0 0x7fdf2c0bae20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 >> 172.21.15.124:0/872228887 conn(0x7fdf2c0bcf70 msgr2=0x7fdf2c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 shutdown_connections 2024-01-24T12:43:48.050 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.048+0000 7fdf330bb640 1 -- 172.21.15.124:0/872228887 wait complete. 2024-01-24T12:43:48.061 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.060+0000 7fd7c623f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T12:43:48.066 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 83339161-25cf-4ba5-9af9-a6a32cb24473 1 2024-01-24T12:43:48.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 Processor -- start 2024-01-24T12:43:48.181 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 -- start start 2024-01-24T12:43:48.182 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c406e220 con 0x7f77c40b5060 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40ba850 con 0x7f77c40b44a0 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77cc0a2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c406df40 con 0x7f77c40a0c90 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77c9e3e640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f77c40b44a0 0x7f77c41427e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:54064/0 (socket says 172.21.15.124:54064) 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77c9e3e640 1 -- 172.21.15.124:0/3415292577 learned_addr learned my addr 172.21.15.124:0/3415292577 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77ca63f640 1 --2- 172.21.15.124:0/3415292577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058343706 0 0) 0x7f77c40ba850 con 0x7f77c40b44a0 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ac003530 con 0x7f77c40b44a0 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77ca63f640 1 -- 172.21.15.124:0/3415292577 >> v1:172.21.15.124:6789/0 conn(0x7f77c40b44a0 legacy=0x7f77c41427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954972819 0 0) 0x7f77ac003530 con 0x7f77c40b44a0 2024-01-24T12:43:48.183 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77ca63f640 1 -- 172.21.15.124:0/3415292577 >> v1:172.21.15.27:6789/0 conn(0x7f77c40b5060 legacy=0x7f77c4148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.184 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.180+0000 7f77ca63f640 1 -- 172.21.15.124:0/3415292577 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4148a00 con 0x7f77c40a0c90 2024-01-24T12:43:48.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77ca63f640 1 --2- 172.21.15.124:0/3415292577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c41541f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009df0 tx=0x7f77bc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26ac256b45134b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4001680 con 0x7f77c40a0c90 2024-01-24T12:43:48.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc0a5640 con 0x7f77c40a0c90 2024-01-24T12:43:48.185 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c8e3c640 1 -- 172.21.15.124:0/3415292577 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0a59d0 con 0x7f77c40a0c90 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3415292577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 msgr2=0x7f77c41541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3415292577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c41541f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009df0 tx=0x7f77bc01c8b0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3415292577 shutdown_connections 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3415292577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c41541f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3415292577 >> 172.21.15.124:0/3415292577 conn(0x7f77c40babc0 msgr2=0x7f77c40bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3415292577 shutdown_connections 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3415292577 wait complete. 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 Processor -- start 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- start start 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77c40b44a0 0x7f77c40b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 0x7f77c40b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.190 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40a3030 con 0x7f77c40b5060 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c413c330 con 0x7f77c40b44a0 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77cc0a2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c413e530 con 0x7f77c40a0c90 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35308/0 (socket says 172.21.15.124:35308) 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 -- 172.21.15.124:0/3795837037 learned_addr learned my addr 172.21.15.124:0/3795837037 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c963d640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77c40b44a0 0x7f77c40b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77ca63f640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 0x7f77c40b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 -- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77c40b44a0 msgr2=0x7f77c40b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77c40b44a0 0x7f77c40b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 -- 172.21.15.124:0/3795837037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 msgr2=0x7f77c40b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 0x7f77c40b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 -- 172.21.15.124:0/3795837037 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009a70 con 0x7f77c40a0c90 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77ca63f640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 0x7f77c40b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.184+0000 7f77c9e3e640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c790 tx=0x7f77b400cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.191 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40072d0 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4007450 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40047f0 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c413e810 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c413edd0 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77b4004c50 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f77b40127b0 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c40a34d0 con 0x7f77c40a0c90 2024-01-24T12:43:48.192 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.188+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f77c40a34d0 con 0x7f77c40a0c90 2024-01-24T12:43:48.258 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.256+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83339161-25cf-4ba5-9af9-a6a32cb24473", "id": 1} v 0) v1 -- 0x7f77c413eff0 con 0x7f77c40a0c90 2024-01-24T12:43:48.268 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77c27fc640 1 -- 172.21.15.124:0/3795837037 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83339161-25cf-4ba5-9af9-a6a32cb24473", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77b4018070 con 0x7f77c40a0c90 2024-01-24T12:43:48.268 INFO:teuthology.orchestra.run.smithi124.stdout:1 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 msgr2=0x7f77c40a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c790 tx=0x7f77b400cc50 comp rx=0 tx=0).stop 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 shutdown_connections 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f77c40b5060 0x7f77c40b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f77c40b44a0 0x7f77c40b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 --2- 172.21.15.124:0/3795837037 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f77c40a0c90 0x7f77c40a2af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.270 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 >> 172.21.15.124:0/3795837037 conn(0x7f77c40babc0 msgr2=0x7f77c41480f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 shutdown_connections 2024-01-24T12:43:48.271 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.268+0000 7f77cc0a2640 1 -- 172.21.15.124:0/3795837037 wait complete. 2024-01-24T12:43:48.285 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 276b88b3-3381-4775-86fe-a5178646e235 2 2024-01-24T12:43:48.396 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.392+0000 7f094f73a640 1 Processor -- start 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.392+0000 7f094f73a640 1 -- start start 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.392+0000 7f094f73a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f09480b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.392+0000 7f094f73a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f09480b3dd0 0x7f0948151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094806fc40 con 0x7f0948147640 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480706d0 con 0x7f09480b3dd0 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094806ff20 con 0x7f09480b9b50 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094d4d6640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f09480b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f09480b3dd0 0x7f0948151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f09480b3dd0 0x7f0948151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60204/0 (socket says 172.21.15.124:60204) 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094d4d6640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f09480b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35312/0 (socket says 172.21.15.124:35312) 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 -- 172.21.15.124:0/1381930532 learned_addr learned my addr 172.21.15.124:0/1381930532 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.397 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 -- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 msgr2=0x7f09480b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:48.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 --2- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f09480b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 -- 172.21.15.124:0/1381930532 >> v1:172.21.15.27:6789/0 conn(0x7f0948147640 legacy=0x7f09481414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:48.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 -- 172.21.15.124:0/1381930532 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948070200 con 0x7f09480b3dd0 2024-01-24T12:43:48.398 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094dcd7640 1 --2- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f0948151f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0940009e50 tx=0x7f094001c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b613874f1fe551ca server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f093ffff640 1 -- 172.21.15.124:0/1381930532 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400a5740 con 0x7f09480b3dd0 2024-01-24T12:43:48.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f093ffff640 1 -- 172.21.15.124:0/1381930532 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09400a58a0 con 0x7f09480b3dd0 2024-01-24T12:43:48.399 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f093ffff640 1 -- 172.21.15.124:0/1381930532 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400a5c30 con 0x7f09480b3dd0 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 msgr2=0x7f0948151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 --2- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f0948151f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0940009e50 tx=0x7f094001c9d0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- 172.21.15.124:0/1381930532 shutdown_connections 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 --2- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f0948151f40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 --2- 172.21.15.124:0/1381930532 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f09480b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- 172.21.15.124:0/1381930532 >> 172.21.15.124:0/1381930532 conn(0x7f09480bcf70 msgr2=0x7f09480bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- 172.21.15.124:0/1381930532 shutdown_connections 2024-01-24T12:43:48.400 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.396+0000 7f094f73a640 1 -- 172.21.15.124:0/1381930532 wait complete. 2024-01-24T12:43:48.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 Processor -- start 2024-01-24T12:43:48.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- start start 2024-01-24T12:43:48.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.403 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f094813c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 0x7f09480b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948151b50 con 0x7f09480b6590 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948151d60 con 0x7f09480b3dd0 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480b5d60 con 0x7f09480b9b50 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60212/0 (socket says 172.21.15.124:60212) 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 -- 172.21.15.124:0/798440939 learned_addr learned my addr 172.21.15.124:0/798440939 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094ccd5640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f094813c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094dcd7640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 0x7f09480b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 -- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 msgr2=0x7f094813c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f094813c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.404 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 -- 172.21.15.124:0/798440939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 msgr2=0x7f09480b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 0x7f09480b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 -- 172.21.15.124:0/798440939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940009b30 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094dcd7640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 0x7f09480b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094d4d6640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f094400e930 tx=0x7f094400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944009690 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400ca00 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094813c230 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400cd70 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09480b6040 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0944005ca0 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0944013890 con 0x7f09480b3dd0 2024-01-24T12:43:48.405 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.400+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094804e000 con 0x7f09480b3dd0 2024-01-24T12:43:48.406 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.404+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f0944021060 con 0x7f09480b3dd0 2024-01-24T12:43:48.472 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.472+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "276b88b3-3381-4775-86fe-a5178646e235", "id": 2} v 0) v1 -- 0x7f094813f640 con 0x7f09480b3dd0 2024-01-24T12:43:48.481 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f093dffb640 1 -- 172.21.15.124:0/798440939 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "276b88b3-3381-4775-86fe-a5178646e235", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f094402a0b0 con 0x7f09480b3dd0 2024-01-24T12:43:48.481 INFO:teuthology.orchestra.run.smithi124.stdout:2 2024-01-24T12:43:48.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 msgr2=0x7f09481e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.482 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f094400e930 tx=0x7f094400edf0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 shutdown_connections 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09480b6590 0x7f09480b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f09480b9b50 0x7f094813c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 --2- 172.21.15.124:0/798440939 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f09480b3dd0 0x7f09481e6700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 >> 172.21.15.124:0/798440939 conn(0x7f09480bcf70 msgr2=0x7f094813e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 shutdown_connections 2024-01-24T12:43:48.483 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.480+0000 7f094f73a640 1 -- 172.21.15.124:0/798440939 wait complete. 2024-01-24T12:43:48.497 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 70572fb0-83b9-41aa-9a4c-ba6190b304da 3 2024-01-24T12:43:48.518 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.517+0000 7f1fbd03c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T12:43:48.574 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.573+0000 7f1fbd03c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T12:43:48.614 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 Processor -- start 2024-01-24T12:43:48.615 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 -- start start 2024-01-24T12:43:48.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac0145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac0071850 con 0x7f2ac0151150 2024-01-24T12:43:48.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac00b8950 con 0x7f2ac006af90 2024-01-24T12:43:48.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac7a14640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00b53f0 con 0x7f2ac01458f0 2024-01-24T12:43:48.616 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac57b0640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2ac006af90 0x7f2ac0148900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:54068/0 (socket says 172.21.15.124:54068) 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac57b0640 1 -- 172.21.15.124:0/2547134195 learned_addr learned my addr 172.21.15.124:0/2547134195 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.612+0000 7f2ac4faf640 1 --2- 172.21.15.124:0/2547134195 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac0145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ab7fff640 1 -- 172.21.15.124:0/2547134195 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332657289 0 0) 0x7f2ac00b8950 con 0x7f2ac006af90 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ab7fff640 1 -- 172.21.15.124:0/2547134195 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aac003530 con 0x7f2ac006af90 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac4faf640 1 -- 172.21.15.124:0/2547134195 >> v1:172.21.15.124:6789/0 conn(0x7f2ac006af90 legacy=0x7f2ac0148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac4faf640 1 -- 172.21.15.124:0/2547134195 >> v1:172.21.15.27:6789/0 conn(0x7f2ac0151150 legacy=0x7f2ac0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:48.617 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac4faf640 1 -- 172.21.15.124:0/2547134195 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00b3e30 con 0x7f2ac01458f0 2024-01-24T12:43:48.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac4faf640 1 --2- 172.21.15.124:0/2547134195 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac0145d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097f0 tx=0x7f2ab001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=696fbdeb287ddb53 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ab7fff640 1 -- 172.21.15.124:0/2547134195 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab600 con 0x7f2ac01458f0 2024-01-24T12:43:48.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ab7fff640 1 -- 172.21.15.124:0/2547134195 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00a7050 con 0x7f2ac01458f0 2024-01-24T12:43:48.618 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ab7fff640 1 -- 172.21.15.124:0/2547134195 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab980 con 0x7f2ac01458f0 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 -- 172.21.15.124:0/2547134195 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 msgr2=0x7f2ac0145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/2547134195 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac0145d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097f0 tx=0x7f2ab001c480 comp rx=0 tx=0).stop 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 -- 172.21.15.124:0/2547134195 shutdown_connections 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/2547134195 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac0145d50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 -- 172.21.15.124:0/2547134195 >> 172.21.15.124:0/2547134195 conn(0x7f2ac00b9140 msgr2=0x7f2ac00b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 -- 172.21.15.124:0/2547134195 shutdown_connections 2024-01-24T12:43:48.619 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.616+0000 7f2ac7a14640 1 -- 172.21.15.124:0/2547134195 wait complete. 2024-01-24T12:43:48.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 Processor -- start 2024-01-24T12:43:48.620 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- start start 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ac006af90 0x7f2ac00b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ac0151150 0x7f2ac0137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00b19f0 con 0x7f2ac006af90 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00b21e0 con 0x7f2ac0151150 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00b24c0 con 0x7f2ac01458f0 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35340/0 (socket says 172.21.15.124:35340) 2024-01-24T12:43:48.622 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 -- 172.21.15.124:0/411492468 learned_addr learned my addr 172.21.15.124:0/411492468 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac5fb1640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ac0151150 0x7f2ac0137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac57b0640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ac006af90 0x7f2ac00b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 -- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ac0151150 msgr2=0x7f2ac0137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ac0151150 0x7f2ac0137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 -- 172.21.15.124:0/411492468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ac006af90 msgr2=0x7f2ac00b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ac006af90 0x7f2ac00b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 -- 172.21.15.124:0/411492468 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009420 con 0x7f2ac01458f0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac4faf640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097f0 tx=0x7f2ab0019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b4410 con 0x7f2ac01458f0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00b4570 con 0x7f2ac01458f0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac00b27a0 con 0x7f2ac01458f0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b4920 con 0x7f2ac01458f0 2024-01-24T12:43:48.623 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac00b2ef0 con 0x7f2ac01458f0 2024-01-24T12:43:48.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ab00b2040 con 0x7f2ac01458f0 2024-01-24T12:43:48.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2ab00bf3c0 con 0x7f2ac01458f0 2024-01-24T12:43:48.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.620+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac004e000 con 0x7f2ac01458f0 2024-01-24T12:43:48.624 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.624+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f2ab00b0070 con 0x7f2ac01458f0 2024-01-24T12:43:48.629 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.629+0000 7f1fbd03c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T12:43:48.641 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.640+0000 7fd7c623f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T12:43:48.691 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.688+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70572fb0-83b9-41aa-9a4c-ba6190b304da", "id": 3} v 0) v1 -- 0x7f2ac01e02b0 con 0x7f2ac01458f0 2024-01-24T12:43:48.695 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.692+0000 7fd7c623f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T12:43:48.700 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ab5ffb640 1 -- 172.21.15.124:0/411492468 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70572fb0-83b9-41aa-9a4c-ba6190b304da", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ab00c0460 con 0x7f2ac01458f0 2024-01-24T12:43:48.700 INFO:teuthology.orchestra.run.smithi124.stdout:3 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 msgr2=0x7f2ac01475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00097f0 tx=0x7f2ab0019220 comp rx=0 tx=0).stop 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 shutdown_connections 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ac0151150 0x7f2ac0137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ac01458f0 0x7f2ac01475c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 --2- 172.21.15.124:0/411492468 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ac006af90 0x7f2ac00b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 >> 172.21.15.124:0/411492468 conn(0x7f2ac00b9140 msgr2=0x7f2ac013b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 shutdown_connections 2024-01-24T12:43:48.702 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.700+0000 7f2ac7a14640 1 -- 172.21.15.124:0/411492468 wait complete. 2024-01-24T12:43:48.710 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.709+0000 7f1fbd03c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T12:43:48.716 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new c438646a-e5ea-461f-bcd1-7c46aac26cbb 4 2024-01-24T12:43:48.751 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.748+0000 7fd7c623f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T12:43:48.764 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.761+0000 7f1fbd03c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T12:43:48.830 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 Processor -- start 2024-01-24T12:43:48.830 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.828+0000 7fd7c623f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T12:43:48.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 -- start start 2024-01-24T12:43:48.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8c0c1429f0 0x7f8c0c0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c0c071560 0x7f8c0c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.831 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c070670 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b91a0 con 0x7f8c0c1429f0 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c1312c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b7cf0 con 0x7f8c0c071560 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c0c071560 0x7f8c0c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c0c071560 0x7f8c0c1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60224/0 (socket says 172.21.15.124:60224) 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 -- 172.21.15.124:0/2334240038 learned_addr learned my addr 172.21.15.124:0/2334240038 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c10ec8640 1 --2- 172.21.15.124:0/2334240038 >> v2:172.21.15.27:3300/0 conn(0x7f8c0c1429f0 0x7f8c0c0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 -- 172.21.15.124:0/2334240038 >> v2:172.21.15.27:3300/0 conn(0x7f8c0c1429f0 msgr2=0x7f8c0c0b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 --2- 172.21.15.124:0/2334240038 >> v2:172.21.15.27:3300/0 conn(0x7f8c0c1429f0 0x7f8c0c0b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 -- 172.21.15.124:0/2334240038 >> v1:172.21.15.27:6789/0 conn(0x7f8c0c0b3e20 legacy=0x7f8c0c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:48.832 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.828+0000 7f8c116c9640 1 -- 172.21.15.124:0/2334240038 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0b8b50 con 0x7f8c0c071560 2024-01-24T12:43:48.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c116c9640 1 --2- 172.21.15.124:0/2334240038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c071560 0x7f8c0c1530c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06fb00 tx=0x7f8c0401f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bafa38ba975ee40a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c0b7fe640 1 -- 172.21.15.124:0/2334240038 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040af400 con 0x7f8c0c071560 2024-01-24T12:43:48.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c0b7fe640 1 -- 172.21.15.124:0/2334240038 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040ab050 con 0x7f8c0c071560 2024-01-24T12:43:48.834 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c0b7fe640 1 -- 172.21.15.124:0/2334240038 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040af780 con 0x7f8c0c071560 2024-01-24T12:43:48.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 -- 172.21.15.124:0/2334240038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c071560 msgr2=0x7f8c0c1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 --2- 172.21.15.124:0/2334240038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c071560 0x7f8c0c1530c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06fb00 tx=0x7f8c0401f180 comp rx=0 tx=0).stop 2024-01-24T12:43:48.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 -- 172.21.15.124:0/2334240038 shutdown_connections 2024-01-24T12:43:48.835 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 --2- 172.21.15.124:0/2334240038 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c071560 0x7f8c0c1530c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 --2- 172.21.15.124:0/2334240038 >> v2:172.21.15.27:3300/0 conn(0x7f8c0c1429f0 0x7f8c0c0b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 -- 172.21.15.124:0/2334240038 >> 172.21.15.124:0/2334240038 conn(0x7f8c0c0bcf70 msgr2=0x7f8c0c0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 -- 172.21.15.124:0/2334240038 shutdown_connections 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.832+0000 7f8c1312c640 1 -- 172.21.15.124:0/2334240038 wait complete. 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 Processor -- start 2024-01-24T12:43:48.836 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- start start 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 0x7f8c0c137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 0x7f8c0c1d21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1e1570 con 0x7f8c0c1429f0 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1d1d30 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.839 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1d36f0 con 0x7f8c0c071560 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c10ec8640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 0x7f8c0c137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c10ec8640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35346/0 (socket says 172.21.15.124:35346) 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c10ec8640 1 -- 172.21.15.124:0/3563656292 learned_addr learned my addr 172.21.15.124:0/3563656292 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c116c9640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 0x7f8c0c1d21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 -- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 msgr2=0x7f8c0c13a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 -- 172.21.15.124:0/3563656292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 msgr2=0x7f8c0c1d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 0x7f8c0c1d21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 -- 172.21.15.124:0/3563656292 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009b30 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c10ec8640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c116c9640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 0x7f8c0c1d21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c0bfff640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 0x7f8c0c137ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3e0 tx=0x7f8bfc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:48.840 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011790 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0118f0 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c1d39d0 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011ce0 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c0bcc50 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8bfc01c760 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8bfc012c50 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.836+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c067050 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.841 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.840+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f8bfc011e40 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.844 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.841+0000 7f1fbd03c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T12:43:48.885 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.884+0000 7fd7c623f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T12:43:48.898 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:48.897+0000 7f1fbd03c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T12:43:48.909 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.908+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c438646a-e5ea-461f-bcd1-7c46aac26cbb", "id": 4} v 0) v1 -- 0x7f8c0c0702e0 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.919 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.916+0000 7f8c097fa640 1 -- 172.21.15.124:0/3563656292 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c438646a-e5ea-461f-bcd1-7c46aac26cbb", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8bfc02b0b0 con 0x7f8c0c0b3e20 2024-01-24T12:43:48.919 INFO:teuthology.orchestra.run.smithi124.stdout:4 2024-01-24T12:43:48.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 msgr2=0x7f8c0c137ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:48.920 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 0x7f8c0c137ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c3e0 tx=0x7f8bfc00c8a0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 shutdown_connections 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c0c1429f0 0x7f8c0c1d21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c0c0b3e20 0x7f8c0c137ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 --2- 172.21.15.124:0/3563656292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c0c071560 0x7f8c0c13a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 >> 172.21.15.124:0/3563656292 conn(0x7f8c0c0bcf70 msgr2=0x7f8c0c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 shutdown_connections 2024-01-24T12:43:48.921 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:48.920+0000 7f8c1312c640 1 -- 172.21.15.124:0/3563656292 wait complete. 2024-01-24T12:43:48.936 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new ccec405d-3dfc-4e49-906d-49ee028fa898 5 2024-01-24T12:43:48.965 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:48.964+0000 7fd7c623f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T12:43:49.018 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:49.016+0000 7fd7c623f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T12:43:49.045 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:49.045+0000 7f1fbd03c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T12:43:49.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.076+0000 7f6ca271f640 1 Processor -- start 2024-01-24T12:43:49.079 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.076+0000 7f6ca271f640 1 -- start start 2024-01-24T12:43:49.080 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6c9c06ad30 0x7f6c9c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.080 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6c9c0702c0 0x7f6c9c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c06fa50 con 0x7f6c9c146e00 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0711f0 con 0x7f6c9c06ad30 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0af8b0 con 0x7f6c9c0702c0 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9b7fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f6c9c146e00 0x7f6c9c070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:54078/0 (socket says 172.21.15.124:54078) 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9b7fe640 1 -- 172.21.15.124:0/748166933 learned_addr learned my addr 172.21.15.124:0/748166933 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/748166933 >> v2:172.21.15.124:3300/0 conn(0x7f6c9c0702c0 0x7f6c9c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9bfff640 1 --2- 172.21.15.124:0/748166933 >> v2:172.21.15.27:3300/0 conn(0x7f6c9c06ad30 0x7f6c9c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/748166933 >> v2:172.21.15.27:3300/0 conn(0x7f6c9c06ad30 msgr2=0x7f6c9c06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/748166933 >> v2:172.21.15.27:3300/0 conn(0x7f6c9c06ad30 0x7f6c9c06b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/748166933 >> v1:172.21.15.124:6789/0 conn(0x7f6c9c146e00 legacy=0x7f6c9c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.081 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/748166933 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c06f6e0 con 0x7f6c9c0702c0 2024-01-24T12:43:49.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/748166933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1516a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0ba240 tx=0x7f6c9401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c139c7c4ebf0a2fd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9affd640 1 -- 172.21.15.124:0/748166933 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940a5970 con 0x7f6c9c0702c0 2024-01-24T12:43:49.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9affd640 1 -- 172.21.15.124:0/748166933 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940a5ad0 con 0x7f6c9c0702c0 2024-01-24T12:43:49.083 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6c9affd640 1 -- 172.21.15.124:0/748166933 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940a5e60 con 0x7f6c9c0702c0 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- 172.21.15.124:0/748166933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c0702c0 msgr2=0x7f6c9c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 --2- 172.21.15.124:0/748166933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1516a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0ba240 tx=0x7f6c9401c910 comp rx=0 tx=0).stop 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- 172.21.15.124:0/748166933 shutdown_connections 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 --2- 172.21.15.124:0/748166933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1516a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 --2- 172.21.15.124:0/748166933 >> v2:172.21.15.27:3300/0 conn(0x7f6c9c06ad30 0x7f6c9c06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- 172.21.15.124:0/748166933 >> 172.21.15.124:0/748166933 conn(0x7f6c9c0b9140 msgr2=0x7f6c9c0b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- 172.21.15.124:0/748166933 shutdown_connections 2024-01-24T12:43:49.084 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.080+0000 7f6ca271f640 1 -- 172.21.15.124:0/748166933 wait complete. 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 Processor -- start 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- start start 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 0x7f6c9c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1e4630 con 0x7f6c9c0702c0 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1e2050 con 0x7f6c9c06ad30 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b0360 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 0x7f6c9c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.087 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60246/0 (socket says 172.21.15.124:60246) 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c9bfff640 1 -- 172.21.15.124:0/1904088566 learned_addr learned my addr 172.21.15.124:0/1904088566 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c9b7fe640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 msgr2=0x7f6c9c13b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/1904088566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c9c0702c0 msgr2=0x7f6c9c1e4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1e4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 -- 172.21.15.124:0/1904088566 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009a70 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c9bfff640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca0cbc640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 0x7f6c9c0b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c940ac000 tx=0x7f6c940196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940ade80 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94009450 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.088 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940b9670 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.089 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0b10c0 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.089 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c1e4880 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.089 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c940b9ad0 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.089 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6c940b9d80 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.089 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.084+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c0bab60 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.090 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.088+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6c940b2070 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.108 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:49.105+0000 7f1fbd03c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T12:43:49.158 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.156+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ccec405d-3dfc-4e49-906d-49ee028fa898", "id": 5} v 0) v1 -- 0x7f6c9c1e4a70 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.163 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:49.160+0000 7fd7c623f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T12:43:49.167 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.164+0000 7f6c98ff9640 1 -- 172.21.15.124:0/1904088566 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ccec405d-3dfc-4e49-906d-49ee028fa898", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c940c4460 con 0x7f6c9c1e52e0 2024-01-24T12:43:49.167 INFO:teuthology.orchestra.run.smithi124.stdout:5 2024-01-24T12:43:49.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 msgr2=0x7f6c9c0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 0x7f6c9c0b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c940ac000 tx=0x7f6c940196b0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 shutdown_connections 2024-01-24T12:43:49.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6c9c1e52e0 0x7f6c9c0b1ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.168 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c9c0702c0 0x7f6c9c1e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 --2- 172.21.15.124:0/1904088566 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6c9c06ad30 0x7f6c9c13b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 >> 172.21.15.124:0/1904088566 conn(0x7f6c9c0b9140 msgr2=0x7f6c9c070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 shutdown_connections 2024-01-24T12:43:49.169 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.168+0000 7f6ca271f640 1 -- 172.21.15.124:0/1904088566 wait complete. 2024-01-24T12:43:49.184 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 14b393b9-490b-4ea6-958e-47695fe336a1 6 2024-01-24T12:43:49.226 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:49.224+0000 7fd7c623f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T12:43:49.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 Processor -- start 2024-01-24T12:43:49.294 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 -- start start 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7f880a0c90 0x7f7f881541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8806e220 con 0x7f7f880b44a0 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f880ba850 con 0x7f7f880b5060 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f8d565640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8806df40 con 0x7f7f880a0c90 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f867fc640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7f880b5060 0x7f7f88148f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:54092/0 (socket says 172.21.15.124:54092) 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f867fc640 1 -- 172.21.15.124:0/3279736079 learned_addr learned my addr 172.21.15.124:0/3279736079 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f877fe640 1 --2- 172.21.15.124:0/3279736079 >> v2:172.21.15.27:3300/0 conn(0x7f7f880a0c90 0x7f7f881541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723028945 0 0) 0x7f7f880ba850 con 0x7f7f880b5060 2024-01-24T12:43:49.297 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f70003530 con 0x7f7f880b5060 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225262931 0 0) 0x7f7f70003530 con 0x7f7f880b5060 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 >> v2:172.21.15.27:3300/0 conn(0x7f7f880a0c90 msgr2=0x7f7f881541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 --2- 172.21.15.124:0/3279736079 >> v2:172.21.15.27:3300/0 conn(0x7f7f880a0c90 0x7f7f881541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 >> v1:172.21.15.27:6789/0 conn(0x7f7f880b44a0 legacy=0x7f7f881427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.292+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88148a00 con 0x7f7f880b5060 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f7f7c001680 con 0x7f7f880b5060 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 >> v1:172.21.15.124:6789/0 conn(0x7f7f880b5060 legacy=0x7f7f88148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f70005190 0x7f7f7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8806df40 con 0x7f7f700047d0 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7000c030 con 0x7f7f70003980 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7000c1f0 con 0x7f7f70005190 2024-01-24T12:43:49.298 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f877fe640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f70005190 0x7f7f7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f867fc640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 -- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f70005190 msgr2=0x7f7f7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f70005190 0x7f7f7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 -- 172.21.15.124:0/3279736079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f700047d0 msgr2=0x7f7f70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f700047d0 0x7f7f70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 -- 172.21.15.124:0/3279736079 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70003530 con 0x7f7f70003980 2024-01-24T12:43:49.299 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f877fe640 1 -- 172.21.15.124:0/3279736079 reap_dead start 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f86ffd640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f78001780 tx=0x7f7f7801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8beaa3ef85d88 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f780a4ea0 con 0x7f7f70003980 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f780a7050 con 0x7f7f70003980 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f85ffb640 1 -- 172.21.15.124:0/3279736079 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78003600 con 0x7f7f70003980 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 -- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 msgr2=0x7f7f70003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.300 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f78001780 tx=0x7f7f7801c3e0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 -- 172.21.15.124:0/3279736079 shutdown_connections 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 --2- 172.21.15.124:0/3279736079 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f70003da0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 -- 172.21.15.124:0/3279736079 >> 172.21.15.124:0/3279736079 conn(0x7f7f880babc0 msgr2=0x7f7f880bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 -- 172.21.15.124:0/3279736079 shutdown_connections 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.296+0000 7f7f8d565640 1 -- 172.21.15.124:0/3279736079 wait complete. 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 Processor -- start 2024-01-24T12:43:49.301 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- start start 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f8813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 0x7f7f881e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f880a2910 0x7f7f8813a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f881e1940 con 0x7f7f880a2910 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880a2d90 con 0x7f7f70003980 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8813e360 con 0x7f7f8813de10 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f8813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 0x7f7f881e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f8813ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.124:60268/0 (socket says 172.21.15.124:60268) 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f86ffd640 1 -- 172.21.15.124:0/2381549584 learned_addr learned my addr 172.21.15.124:0/2381549584 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f877fe640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f880a2910 0x7f7f8813a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.304 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 -- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 msgr2=0x7f7f8813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f8813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 -- 172.21.15.124:0/2381549584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f880a2910 msgr2=0x7f7f8813a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f880a2910 0x7f7f8813a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 -- 172.21.15.124:0/2381549584 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8813cc70 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f867fc640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 0x7f7f881e1400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f8806ad20 tx=0x7f7f7c011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00fb30 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00fc90 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c015410 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8813cf50 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8813c900 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7f7c015570 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7f7c01fc30 con 0x7f7f8813de10 2024-01-24T12:43:49.305 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.300+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8813e780 con 0x7f7f8813de10 2024-01-24T12:43:49.306 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.304+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f7f7c010040 con 0x7f7f8813de10 2024-01-24T12:43:49.373 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.372+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd new", "uuid": "14b393b9-490b-4ea6-958e-47695fe336a1", "id": 6} v 0) v1 -- 0x7f7f8804e000 con 0x7f7f8813de10 2024-01-24T12:43:49.381 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f6f7fe640 1 -- 172.21.15.124:0/2381549584 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14b393b9-490b-4ea6-958e-47695fe336a1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f7c02e0b0 con 0x7f7f8813de10 2024-01-24T12:43:49.381 INFO:teuthology.orchestra.run.smithi124.stdout:6 2024-01-24T12:43:49.382 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 msgr2=0x7f7f881e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 0x7f7f881e1400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f8806ad20 tx=0x7f7f7c011d10 comp rx=0 tx=0).stop 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 shutdown_connections 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f880a2910 0x7f7f8813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7f8813de10 0x7f7f881e1400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 --2- 172.21.15.124:0/2381549584 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7f70003980 0x7f7f8813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 >> 172.21.15.124:0/2381549584 conn(0x7f7f880babc0 msgr2=0x7f7f880bb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 shutdown_connections 2024-01-24T12:43:49.383 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.380+0000 7f7f8d565640 1 -- 172.21.15.124:0/2381549584 wait complete. 2024-01-24T12:43:49.398 DEBUG:teuthology.orchestra.run.smithi124:> sudo ceph --cluster ceph osd new 44ce85bf-7710-4bf8-9ea1-46e665a7036c 7 2024-01-24T12:43:49.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.584+0000 7f0902cef640 1 Processor -- start 2024-01-24T12:43:49.587 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.584+0000 7f0902cef640 1 -- start start 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0902cef640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f08fc0bc840 0x7f08fc0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0902cef640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc06c340 con 0x7f08fc0b7950 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0902cef640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc06bcf0 con 0x7f08fc1476f0 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0902cef640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc06c7d0 con 0x7f08fc0bc840 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f090128c640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f08fc1476f0 0x7f08fc151270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.124:54108/0 (socket says 172.21.15.124:54108) 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f090128c640 1 -- 172.21.15.124:0/2760841920 learned_addr learned my addr 172.21.15.124:0/2760841920 (peer_addr_for_me v1:172.21.15.124:0/0) 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921227348 0 0) 0x7f08fc06bcf0 con 0x7f08fc1476f0 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08ec003530 con 0x7f08fc1476f0 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 --2- 172.21.15.124:0/2760841920 >> v2:172.21.15.27:3300/0 conn(0x7f08fc0bc840 0x7f08fc0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.590 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v1:172.21.15.124:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884053833 0 0) 0x7f08ec003530 con 0x7f08fc1476f0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 >> v2:172.21.15.27:3300/0 conn(0x7f08fc0bc840 msgr2=0x7f08fc0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 --2- 172.21.15.124:0/2760841920 >> v2:172.21.15.27:3300/0 conn(0x7f08fc0bc840 0x7f08fc0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 >> v1:172.21.15.27:6789/0 conn(0x7f08fc0b7950 legacy=0x7f08fc146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 --> v1:172.21.15.124:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc06bfd0 con 0x7f08fc1476f0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v1:172.21.15.124:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f08f4001a00 con 0x7f08fc1476f0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 >> v1:172.21.15.124:6789/0 conn(0x7f08fc1476f0 legacy=0x7f08fc151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08ec003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08ec0047d0 0x7f08ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08ec005190 0x7f08ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc06c7d0 con 0x7f08ec0047d0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec00c070 con 0x7f08ec0039d0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec00c230 con 0x7f08ec005190 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08ec003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.591 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f090128c640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08ec005190 0x7f08ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fbfff640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08ec0047d0 0x7f08ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 -- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08ec005190 msgr2=0x7f08ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08ec005190 0x7f08ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 -- 172.21.15.124:0/2760841920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08ec0047d0 msgr2=0x7f08ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08ec0047d0 0x7f08ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 -- 172.21.15.124:0/2760841920 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec003530 con 0x7f08ec0039d0 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fbfff640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08ec0047d0 0x7f08ec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:43:49.592 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f090128c640 1 -- 172.21.15.124:0/2760841920 reap_dead start 2024-01-24T12:43:49.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f0900a8b640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08ec003df0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7d9cc6998c4619 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.595 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00a5640 con 0x7f08ec0039d0 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f00a57a0 con 0x7f08ec0039d0 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.588+0000 7f08fb7fe640 1 -- 172.21.15.124:0/2760841920 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00a5b50 con 0x7f08ec0039d0 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 msgr2=0x7f08ec003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08ec003df0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f001ca50 comp rx=0 tx=0).stop 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/2760841920 shutdown_connections 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 --2- 172.21.15.124:0/2760841920 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08ec003df0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/2760841920 >> 172.21.15.124:0/2760841920 conn(0x7f08fc0bbd20 msgr2=0x7f08fc0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/2760841920 shutdown_connections 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/2760841920 wait complete. 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 Processor -- start 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- start start 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08fc1d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08fc149140 0x7f08fc1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.596 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 0x7f08fc1e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc147dd0 con 0x7f08fc149140 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc1d2600 con 0x7f08ec0039d0 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0b3a40 con 0x7f08fc1d4d90 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f090128c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 0x7f08fc1e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08fc1d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f090128c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 0x7f08fc1e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.124:35390/0 (socket says 172.21.15.124:35390) 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f090128c640 1 -- 172.21.15.124:0/481762585 learned_addr learned my addr 172.21.15.124:0/481762585 (peer_addr_for_me v2:172.21.15.124:0/0) 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08fbfff640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08fc149140 0x7f08fc1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 -- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 msgr2=0x7f08fc1e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 0x7f08fc1e00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 -- 172.21.15.124:0/481762585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08fc149140 msgr2=0x7f08fc1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08fc149140 0x7f08fc1481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 -- 172.21.15.124:0/481762585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc149b90 con 0x7f08ec0039d0 2024-01-24T12:43:49.597 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0900a8b640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08fc1d20c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c200 tx=0x7f08f00197f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004220 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f00043c0 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc1495d0 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0003860 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc1d4410 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08f00b4070 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f08f00b6e30 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.592+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc0b8650 con 0x7f08ec0039d0 2024-01-24T12:43:49.598 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.596+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f08f00b2070 con 0x7f08ec0039d0 2024-01-24T12:43:49.664 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.664+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44ce85bf-7710-4bf8-9ea1-46e665a7036c", "id": 7} v 0) v1 -- 0x7f08fc147f10 con 0x7f08ec0039d0 2024-01-24T12:43:49.672 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f08f97fa640 1 -- 172.21.15.124:0/481762585 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44ce85bf-7710-4bf8-9ea1-46e665a7036c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08fc147f10 con 0x7f08ec0039d0 2024-01-24T12:43:49.672 INFO:teuthology.orchestra.run.smithi124.stdout:7 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 msgr2=0x7f08fc1d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08fc1d20c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00c200 tx=0x7f08f00197f0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 shutdown_connections 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f08fc1d4d90 0x7f08fc1e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08fc149140 0x7f08fc1481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 --2- 172.21.15.124:0/481762585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f08ec0039d0 0x7f08fc1d20c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 >> 172.21.15.124:0/481762585 conn(0x7f08fc0bbd20 msgr2=0x7f08fc146150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 shutdown_connections 2024-01-24T12:43:49.674 INFO:teuthology.orchestra.run.smithi124.stderr:2024-01-24T12:43:49.672+0000 7f0902cef640 1 -- 172.21.15.124:0/481762585 wait complete. 2024-01-24T12:43:49.689 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-24T12:43:49.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-24T12:43:49.691 INFO:tasks.ceph.osd.0:Started 2024-01-24T12:43:49.691 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-24T12:43:49.691 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-24T12:43:49.693 INFO:tasks.ceph.osd.1:Started 2024-01-24T12:43:49.694 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-24T12:43:49.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-24T12:43:49.696 INFO:tasks.ceph.osd.2:Started 2024-01-24T12:43:49.696 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-24T12:43:49.696 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-24T12:43:49.699 INFO:tasks.ceph.osd.3:Started 2024-01-24T12:43:49.699 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-24T12:43:49.699 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-24T12:43:49.701 INFO:tasks.ceph.osd.4:Started 2024-01-24T12:43:49.702 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-24T12:43:49.702 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-24T12:43:49.704 INFO:tasks.ceph.osd.5:Started 2024-01-24T12:43:49.704 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-24T12:43:49.704 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-24T12:43:49.706 INFO:tasks.ceph.osd.6:Started 2024-01-24T12:43:49.706 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-24T12:43:49.706 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-24T12:43:49.708 INFO:tasks.ceph.osd.7:Started 2024-01-24T12:43:49.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:43:49.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-24T12:43:49.741 INFO:tasks.ceph.mgr.y.smithi027.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-24T12:43:49.742 INFO:tasks.ceph.mgr.y.smithi027.stderr: from numpy import show_config as show_numpy_config 2024-01-24T12:43:49.784 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:49.781+0000 7f1fbd03c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T12:43:49.820 INFO:tasks.ceph.mgr.x.smithi124.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-24T12:43:49.820 INFO:tasks.ceph.mgr.x.smithi124.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-24T12:43:49.820 INFO:tasks.ceph.mgr.x.smithi124.stderr: from numpy import show_config as show_numpy_config 2024-01-24T12:43:49.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 Processor -- start 2024-01-24T12:43:49.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 -- start start 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb260069d20 0x7fb26006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2600b3b10 0x7fb260155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2600702c0 con 0x7fb2600b81c0 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600b3fa0 con 0x7fb260069d20 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb264fd4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600b8650 con 0x7fb2600b3b10 2024-01-24T12:43:49.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb260069d20 0x7fb26006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb257fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb2600b81c0 0x7fb26014a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34456/0 (socket says 172.21.15.27:34456) 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb257fff640 1 -- 172.21.15.27:0/1647180218 learned_addr learned my addr 172.21.15.27:0/1647180218 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25ed9d640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2600b3b10 0x7fb260155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25e59c640 1 -- 172.21.15.27:0/1647180218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2600b3b10 msgr2=0x7fb260155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25e59c640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2600b3b10 0x7fb260155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25e59c640 1 -- 172.21.15.27:0/1647180218 >> v1:172.21.15.27:6789/0 conn(0x7fb2600b81c0 legacy=0x7fb26014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.833+0000 7fb25e59c640 1 -- 172.21.15.27:0/1647180218 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26006ff50 con 0x7fb260069d20 2024-01-24T12:43:49.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb25e59c640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb260069d20 0x7fb26006a100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb2500097c0 tx=0x7fb25001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1360ca20216922c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb25dd9b640 1 -- 172.21.15.27:0/1647180218 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500ad640 con 0x7fb260069d20 2024-01-24T12:43:49.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb25dd9b640 1 -- 172.21.15.27:0/1647180218 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2500ad7a0 con 0x7fb260069d20 2024-01-24T12:43:49.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb25dd9b640 1 -- 172.21.15.27:0/1647180218 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500adb30 con 0x7fb260069d20 2024-01-24T12:43:49.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- 172.21.15.27:0/1647180218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb260069d20 msgr2=0x7fb26006a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb260069d20 0x7fb26006a100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb2500097c0 tx=0x7fb25001c480 comp rx=0 tx=0).stop 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- 172.21.15.27:0/1647180218 shutdown_connections 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2600b3b10 0x7fb260155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 --2- 172.21.15.27:0/1647180218 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb260069d20 0x7fb26006a100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- 172.21.15.27:0/1647180218 >> 172.21.15.27:0/1647180218 conn(0x7fb26006ae30 msgr2=0x7fb26006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- 172.21.15.27:0/1647180218 shutdown_connections 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- 172.21.15.27:0/1647180218 wait complete. 2024-01-24T12:43:49.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 Processor -- start 2024-01-24T12:43:49.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.837+0000 7fb264fd4640 1 -- start start 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 0x7fb2601e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2600bb1f0 0x7fb26012ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601e6c20 con 0x7fb2600b3b10 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26014a3c0 con 0x7fb2600bb1f0 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260149c50 con 0x7fb260069d20 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33878/0 (socket says 172.21.15.27:33878) 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 -- 172.21.15.27:0/3696801687 learned_addr learned my addr 172.21.15.27:0/3696801687 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb25ed9d640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2600bb1f0 0x7fb26012ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb25e59c640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 0x7fb2601e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 -- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 msgr2=0x7fb2601e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 0x7fb2601e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 -- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2600bb1f0 msgr2=0x7fb26012ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2600bb1f0 0x7fb26012ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 -- 172.21.15.27:0/3696801687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250009420 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb25e59c640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 0x7fb2601e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb257fff640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c400 tx=0x7fb24800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248005cf0 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248005e50 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480072d0 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26014a610 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260148b10 con 0x7fb2600b3b10 2024-01-24T12:43:49.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb24801c440 con 0x7fb2600b3b10 2024-01-24T12:43:49.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb248012ad0 con 0x7fb2600b3b10 2024-01-24T12:43:49.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.841+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260148d00 con 0x7fb2600b3b10 2024-01-24T12:43:49.850 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:49.848+0000 7fd7c623f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T12:43:49.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.865+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb248021060 con 0x7fb2600b3b10 2024-01-24T12:43:49.920 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:49.917+0000 7f1fbd03c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T12:43:49.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.921+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb26004e000 con 0x7fb2600b3b10 2024-01-24T12:43:49.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.921+0000 7fb256ffd640 1 -- 172.21.15.27:0/3696801687 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb248017070 con 0x7fb2600b3b10 2024-01-24T12:43:49.925 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:43:49.925 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:43:49.669258+0000","last_up_change":"0.000000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 msgr2=0x7fb2601e6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c400 tx=0x7fb24800c8c0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 shutdown_connections 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2600bb1f0 0x7fb26012ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2600b3b10 0x7fb2601e6de0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 --2- 172.21.15.27:0/3696801687 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb260069d20 0x7fb2601e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 >> 172.21.15.27:0/3696801687 conn(0x7fb26006ae30 msgr2=0x7fb2600b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 shutdown_connections 2024-01-24T12:43:49.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:43:49.925+0000 7fb264fd4640 1 -- 172.21.15.27:0/3696801687 wait complete. 2024-01-24T12:43:49.942 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-24T12:43:49.943 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-24T12:43:49.970 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:49.968+0000 7fd7c623f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T12:43:50.115 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:50.113+0000 7f1fbd03c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T12:43:50.125 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:50.124+0000 7fd7c623f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T12:43:50.181 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:50.177+0000 7f1fbd03c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T12:43:50.188 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:50.184+0000 7fd7c623f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T12:43:50.309 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:50.308+0000 7fd7c623f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T12:43:50.310 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:50.309+0000 7f1fbd03c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T12:43:50.314 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-24T12:43:50.313+0000 7f7daec89640 -1 Falling back to public interface 2024-01-24T12:43:50.330 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-24T12:43:50.329+0000 7fed70863640 -1 Falling back to public interface 2024-01-24T12:43:50.330 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-24T12:43:50.329+0000 7fb8426ec640 -1 Falling back to public interface 2024-01-24T12:43:50.331 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-24T12:43:50.329+0000 7fb8416ad640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2024-01-24T12:43:50.333 INFO:tasks.ceph.osd.7.smithi124.stderr:2024-01-24T12:43:50.332+0000 7fc6c1c2e640 -1 Falling back to public interface 2024-01-24T12:43:50.334 INFO:tasks.ceph.osd.4.smithi124.stderr:2024-01-24T12:43:50.332+0000 7ff74a717640 -1 Falling back to public interface 2024-01-24T12:43:50.337 INFO:tasks.ceph.osd.5.smithi124.stderr:2024-01-24T12:43:50.336+0000 7fcb8f7c8640 -1 Falling back to public interface 2024-01-24T12:43:50.346 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-24T12:43:50.345+0000 7fbad7a48640 -1 Falling back to public interface 2024-01-24T12:43:50.348 INFO:tasks.ceph.osd.6.smithi124.stderr:2024-01-24T12:43:50.348+0000 7f54340c3640 -1 Falling back to public interface 2024-01-24T12:43:50.749 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T12:43:50.864 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.861+0000 7ffa17021640 1 Processor -- start 2024-01-24T12:43:50.865 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.861+0000 7ffa17021640 1 -- start start 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.861+0000 7ffa17021640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ffa1006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.861+0000 7ffa17021640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa100ba9a0 con 0x7ffa100a0c90 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa17021640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1006e720 con 0x7ffa100b4870 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa17021640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b3500 con 0x7ffa10142c80 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ffa100a0c90 0x7ffa1006d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34460/0 (socket says 172.21.15.27:34460) 2024-01-24T12:43:50.874 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0ffff640 1 -- 172.21.15.27:0/2309440585 learned_addr learned my addr 172.21.15.27:0/2309440585 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa14dbd640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ffa1006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604566456 0 0) 0x7ffa100ba9a0 con 0x7ffa100a0c90 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f8003530 con 0x7ffa100a0c90 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368484152 0 0) 0x7ffa1006e720 con 0x7ffa100b4870 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa100ba9a0 con 0x7ffa100b4870 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731991450 0 0) 0x7ff9f8003530 con 0x7ffa100a0c90 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 msgr2=0x7ffa1006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ffa1006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.875 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 >> v1:172.21.15.124:6789/0 conn(0x7ffa100b4870 legacy=0x7ffa101531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1006df50 con 0x7ffa100a0c90 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7ffa00001680 con 0x7ffa100a0c90 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 >> v1:172.21.15.27:6789/0 conn(0x7ffa100a0c90 legacy=0x7ffa1006d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ff9f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9f80040f0 0x7ff9f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f8004d10 0x7ff9f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b3500 con 0x7ff9f8004d10 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f800bb50 con 0x7ff9f80040f0 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f800bd10 con 0x7ffa10142c80 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f8004d10 0x7ff9f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa14dbd640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ff9f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0ffff640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9f80040f0 0x7ff9f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 -- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 msgr2=0x7ff9f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa10142c80 0x7ff9f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 -- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9f80040f0 msgr2=0x7ff9f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9f80040f0 0x7ff9f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 -- 172.21.15.27:0/2309440585 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8003530 con 0x7ff9f8004d10 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa155be640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f8004d10 0x7ff9f8005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa080018d0 tx=0x7ffa0801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5240e0c1f9c5990c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080052d0 con 0x7ff9f8004d10 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08005450 con 0x7ff9f8004d10 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.865+0000 7ffa0f7fe640 1 -- 172.21.15.27:0/2309440585 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080a8930 con 0x7ff9f8004d10 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/2309440585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f8004d10 msgr2=0x7ff9f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 --2- 172.21.15.27:0/2309440585 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9f8004d10 0x7ff9f8005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa080018d0 tx=0x7ffa0801ecd0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa155be640 1 -- 172.21.15.27:0/2309440585 reap_dead start 2024-01-24T12:43:50.877 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/2309440585 shutdown_connections 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/2309440585 >> 172.21.15.27:0/2309440585 conn(0x7ffa100be180 msgr2=0x7ffa100be590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/2309440585 shutdown_connections 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/2309440585 wait complete. 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 Processor -- start 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- start start 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa10148210 0x7ffa1013a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa1013e160 0x7ffa1013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b7e00 con 0x7ffa100b5190 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101e1380 con 0x7ffa10148210 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101e1660 con 0x7ffa1013e160 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50150/0 (socket says 172.21.15.27:50150) 2024-01-24T12:43:50.878 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 -- 172.21.15.27:0/112517527 learned_addr learned my addr 172.21.15.27:0/112517527 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0ffff640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa10148210 0x7ffa1013a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa155be640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa1013e160 0x7ffa1013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 -- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa1013e160 msgr2=0x7ffa1013ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa1013e160 0x7ffa1013ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 -- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa10148210 msgr2=0x7ffa1013a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa10148210 0x7ffa1013a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 -- 172.21.15.27:0/112517527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa101e1940 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa14dbd640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007f30 tx=0x7ffa04011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400e030 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04016470 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04016820 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa101e1c20 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa100b5570 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffa04016c80 con 0x7ffa100b5190 2024-01-24T12:43:50.879 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ffa0400f070 con 0x7ffa100b5190 2024-01-24T12:43:50.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.869+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10067050 con 0x7ffa100b5190 2024-01-24T12:43:50.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.873+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ffa0403db50 con 0x7ffa100b5190 2024-01-24T12:43:50.926 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:50.924+0000 7fd7c623f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T12:43:50.932 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.929+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa10148a60 con 0x7ffa100b5190 2024-01-24T12:43:50.933 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.929+0000 7ffa0d7fa640 1 -- 172.21.15.27:0/112517527 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ffa0402c070 con 0x7ffa100b5190 2024-01-24T12:43:50.933 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-24T12:43:50.933 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":10,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:43:49.669258+0000","last_up_change":"0.000000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:43:50.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 msgr2=0x7ffa1013dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:50.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007f30 tx=0x7ffa04011660 comp rx=0 tx=0).stop 2024-01-24T12:43:50.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 shutdown_connections 2024-01-24T12:43:50.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ffa1013e160 0x7ffa1013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ffa10148210 0x7ffa1013a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.935 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 --2- 172.21.15.27:0/112517527 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffa100b5190 0x7ffa1013dc20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:50.935 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 >> 172.21.15.27:0/112517527 conn(0x7ffa100be180 msgr2=0x7ffa101d4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:50.935 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 shutdown_connections 2024-01-24T12:43:50.935 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:50.933+0000 7ffa17021640 1 -- 172.21.15.27:0/112517527 wait complete. 2024-01-24T12:43:50.948 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-24T12:43:50.972 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:50.969+0000 7f1fbd03c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T12:43:51.001 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:51.000+0000 7fd7c623f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T12:43:51.052 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:51.049+0000 7f1fbd03c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T12:43:51.169 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:51.168+0000 7fd7c623f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T12:43:51.230 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:51.229+0000 7f1fbd03c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T12:43:51.242 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:51.240+0000 7fd7c623f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T12:43:51.307 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:51.305+0000 7f1fbd03c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T12:43:51.527 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:51.523+0000 7fd7c623f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T12:43:51.585 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:51.583+0000 7fd7c623f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T12:43:51.610 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:51.609+0000 7f1fbd03c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T12:43:51.674 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-24T12:43:51.673+0000 7f1fbd03c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T12:43:52.634 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:52.631+0000 7fd76dafa640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-24T12:43:52.636 INFO:tasks.ceph.mgr.x.smithi124.stderr:2024-01-24T12:43:52.631+0000 7fd76dafa640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-24T12:43:54.153 INFO:tasks.ceph.osd.4.smithi124.stderr:2024-01-24T12:43:54.151+0000 7ff74a717640 -1 osd.4 0 log_to_monitors true 2024-01-24T12:43:54.195 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-24T12:43:54.193+0000 7f7daec89640 -1 osd.3 0 log_to_monitors true 2024-01-24T12:43:54.221 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-24T12:43:54.217+0000 7fed70863640 -1 osd.0 0 log_to_monitors true 2024-01-24T12:43:54.271 INFO:tasks.ceph.osd.6.smithi124.stderr:2024-01-24T12:43:54.267+0000 7f54340c3640 -1 osd.6 0 log_to_monitors true 2024-01-24T12:43:54.292 INFO:tasks.ceph.osd.5.smithi124.stderr:2024-01-24T12:43:54.291+0000 7fcb8f7c8640 -1 osd.5 0 log_to_monitors true 2024-01-24T12:43:54.293 INFO:tasks.ceph.osd.7.smithi124.stderr:2024-01-24T12:43:54.291+0000 7fc6c1c2e640 -1 osd.7 0 log_to_monitors true 2024-01-24T12:43:54.315 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-24T12:43:54.313+0000 7fbad7a48640 -1 osd.2 0 log_to_monitors true 2024-01-24T12:43:54.332 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-24T12:43:54.329+0000 7fb8426ec640 -1 osd.1 0 log_to_monitors true 2024-01-24T12:43:57.757 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T12:43:57.812 INFO:tasks.ceph.osd.7.smithi124.stderr:2024-01-24T12:43:57.807+0000 7fc6bd3b0640 -1 osd.7 0 waiting for initial osdmap 2024-01-24T12:43:57.816 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-24T12:43:57.813+0000 7fed6bfe5640 -1 osd.0 0 waiting for initial osdmap 2024-01-24T12:43:57.840 INFO:tasks.ceph.osd.7.smithi124.stderr:2024-01-24T12:43:57.839+0000 7fc6b59f5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:57.854 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-24T12:43:57.853+0000 7fed6462a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:57.915 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 Processor -- start 2024-01-24T12:43:57.916 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 -- start start 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd0c0b3ad0 0x7efd0c14b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0c0200 con 0x7efd0c06b100 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0bc770 con 0x7efd0c06a710 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd12a8e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0bbb20 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd0c0b3ad0 0x7efd0c14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd0c0b3ad0 0x7efd0c14b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50200/0 (socket says 172.21.15.27:50200) 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0bfff640 1 -- 172.21.15.27:0/797148786 learned_addr learned my addr 172.21.15.27:0/797148786 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:57.917 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd1102b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efd0c06b100 0x7efd0c1555b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49752/0 (socket says 172.21.15.27:49752) 2024-01-24T12:43:57.918 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501814752 0 0) 0x7efd0c0bc770 con 0x7efd0c06a710 2024-01-24T12:43:57.918 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcfc003530 con 0x7efd0c06a710 2024-01-24T12:43:57.918 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0bfff640 1 -- 172.21.15.27:0/797148786 >> v1:172.21.15.124:6789/0 conn(0x7efd0c06a710 legacy=0x7efd0c1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:57.919 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.913+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956319668 0 0) 0x7efd0c0c0200 con 0x7efd0c06b100 2024-01-24T12:43:57.919 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0bfff640 1 -- 172.21.15.27:0/797148786 >> v1:172.21.15.27:6789/0 conn(0x7efd0c06b100 legacy=0x7efd0c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:57.919 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0bfff640 1 -- 172.21.15.27:0/797148786 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0bff60 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.921 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0bfff640 1 --2- 172.21.15.27:0/797148786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c14b340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009870 tx=0x7efcf801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4f1d8acb002e10 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:57.921 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80a8a30 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.921 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf80a8b90 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.921 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.917+0000 7efd0b7fe640 1 -- 172.21.15.27:0/797148786 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf80b0440 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.922 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/797148786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c0b3ad0 msgr2=0x7efd0c14b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 --2- 172.21.15.27:0/797148786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c14b340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009870 tx=0x7efcf801ed30 comp rx=0 tx=0).stop 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/797148786 shutdown_connections 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 --2- 172.21.15.27:0/797148786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c14b340 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/797148786 >> 172.21.15.27:0/797148786 conn(0x7efd0c0c03b0 msgr2=0x7efd0c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/797148786 shutdown_connections 2024-01-24T12:43:57.923 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/797148786 wait complete. 2024-01-24T12:43:57.924 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 Processor -- start 2024-01-24T12:43:57.924 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- start start 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd1082a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd1082a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50208/0 (socket says 172.21.15.27:50208) 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 0x7efd0c1df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd1082a640 1 -- 172.21.15.27:0/3660246480 learned_addr learned my addr 172.21.15.27:0/3660246480 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c1dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.921+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a58d0 con 0x7efd0c06a710 2024-01-24T12:43:57.926 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a3670 con 0x7efd0c0b3ad0 2024-01-24T12:43:57.927 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd0bfff640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 0x7efd0c1df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:57.927 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1102b640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c1dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:57.927 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0b7c50 con 0x7efd0c06b100 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 -- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 msgr2=0x7efd0c1df7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 0x7efd0c1df7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 -- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd0c0b3ad0 msgr2=0x7efd0c1dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c1dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80094d0 con 0x7efd0c06a710 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd0bfff640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 0x7efd0c1df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:43:57.928 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd1082a640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c530 tx=0x7efd0000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:57.929 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000052d0 con 0x7efd0c06a710 2024-01-24T12:43:57.929 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd00005450 con 0x7efd0c06a710 2024-01-24T12:43:57.929 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00012870 con 0x7efd0c06a710 2024-01-24T12:43:57.929 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0a5090 con 0x7efd0c06a710 2024-01-24T12:43:57.930 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.925+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0a55f0 con 0x7efd0c06a710 2024-01-24T12:43:57.930 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7efd000129d0 con 0x7efd0c06a710 2024-01-24T12:43:57.930 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c073790 con 0x7efd0c06a710 2024-01-24T12:43:57.933 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd097fa640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 0x7efcf0067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:43:57.933 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7efd00086a90 con 0x7efd0c06a710 2024-01-24T12:43:57.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd0bfff640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 0x7efcf0067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:43:57.934 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.929+0000 7efd0bfff640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 0x7efcf0067ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efcf80b2000 tx=0x7efcf80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:43:57.936 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-24T12:43:57.933+0000 7fbad31ca640 -1 osd.2 0 waiting for initial osdmap 2024-01-24T12:43:57.938 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:57.937+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efd00087060 con 0x7efd0c06a710 2024-01-24T12:43:57.967 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-24T12:43:57.965+0000 7f7dabc46640 -1 osd.3 0 waiting for initial osdmap 2024-01-24T12:43:57.970 INFO:tasks.ceph.osd.4.smithi124.stderr:2024-01-24T12:43:57.967+0000 7ff7476d4640 -1 osd.4 0 waiting for initial osdmap 2024-01-24T12:43:57.974 INFO:tasks.ceph.osd.6.smithi124.stderr:2024-01-24T12:43:57.971+0000 7f542f845640 -1 osd.6 0 waiting for initial osdmap 2024-01-24T12:43:57.978 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-24T12:43:57.977+0000 7fbacb80f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:57.991 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-24T12:43:57.989+0000 7fb83de6e640 -1 osd.1 0 waiting for initial osdmap 2024-01-24T12:43:57.998 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-24T12:43:57.997+0000 7f7da2a50640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:58.000 INFO:tasks.ceph.osd.5.smithi124.stderr:2024-01-24T12:43:57.995+0000 7fcb8c785640 -1 osd.5 0 waiting for initial osdmap 2024-01-24T12:43:58.005 INFO:tasks.ceph.osd.4.smithi124.stderr:2024-01-24T12:43:58.003+0000 7ff73e4de640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:58.005 INFO:tasks.ceph.osd.6.smithi124.stderr:2024-01-24T12:43:58.003+0000 7f5427e8a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:58.026 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-24T12:43:58.025+0000 7fb8364b3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:58.045 INFO:tasks.ceph.osd.5.smithi124.stderr:2024-01-24T12:43:58.043+0000 7fcb8358f640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T12:43:58.113 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.109+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd0c0bb320 con 0x7efd0c06a710 2024-01-24T12:43:58.114 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd097fa640 1 -- 172.21.15.27:0/3660246480 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efd0004fd00 con 0x7efd0c06a710 2024-01-24T12:43:58.114 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-24T12:43:58.114 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":12,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:43:55.635193+0000","last_up_change":"0.000000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 msgr2=0x7efcf0067ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 0x7efcf0067ec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efcf80b2000 tx=0x7efcf80aa070 comp rx=0 tx=0).stop 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 msgr2=0x7efd0c0a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c530 tx=0x7efd0000c9f0 comp rx=0 tx=0).stop 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 shutdown_connections 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcf0065a00 0x7efcf0067ec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd0c0b3ad0 0x7efd0c1dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd0c06b100 0x7efd0c1df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:58.117 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 --2- 172.21.15.27:0/3660246480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd0c06a710 0x7efd0c0a4b50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:43:58.118 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 >> 172.21.15.27:0/3660246480 conn(0x7efd0c0c03b0 msgr2=0x7efd0c0a0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:43:58.118 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 shutdown_connections 2024-01-24T12:43:58.118 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:43:58.113+0000 7efd12a8e640 1 -- 172.21.15.27:0/3660246480 wait complete. 2024-01-24T12:43:58.131 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-24T12:44:04.939 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:05.063 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 Processor -- start 2024-01-24T12:44:05.063 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 -- start start 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd500b35e0 0x7efd500b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efd500b70e0 0x7efd50153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd500b5020 con 0x7efd500b80c0 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd50071720 con 0x7efd500b35e0 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd55c09640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd50071440 con 0x7efd500b70e0 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd500b35e0 0x7efd500b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd500b35e0 0x7efd500b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55498/0 (socket says 172.21.15.27:55498) 2024-01-24T12:44:05.064 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 -- 172.21.15.27:0/3920215312 learned_addr learned my addr 172.21.15.27:0/3920215312 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4ffff640 1 --2- 172.21.15.27:0/3920215312 >> v2:172.21.15.124:3300/0 conn(0x7efd500b70e0 0x7efd50153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 -- 172.21.15.27:0/3920215312 >> v2:172.21.15.124:3300/0 conn(0x7efd500b70e0 msgr2=0x7efd50153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/3920215312 >> v2:172.21.15.124:3300/0 conn(0x7efd500b70e0 0x7efd50153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 -- 172.21.15.27:0/3920215312 >> v1:172.21.15.27:6789/0 conn(0x7efd500b80c0 legacy=0x7efd501426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4f7fe640 1 -- 172.21.15.27:0/3920215312 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500b5250 con 0x7efd500b35e0 2024-01-24T12:44:05.065 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.064+0000 7efd4effd640 1 -- 172.21.15.27:0/3920215312 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748456319 0 0) 0x7efd500b5020 con 0x7efd500b80c0 2024-01-24T12:44:05.066 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/3920215312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b35e0 0x7efd500b7b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd50071dc0 tx=0x7efd3801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3031cb196bf41b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.066 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4effd640 1 -- 172.21.15.27:0/3920215312 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380a89f0 con 0x7efd500b35e0 2024-01-24T12:44:05.066 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4effd640 1 -- 172.21.15.27:0/3920215312 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380a8b50 con 0x7efd500b35e0 2024-01-24T12:44:05.066 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4effd640 1 -- 172.21.15.27:0/3920215312 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380b0440 con 0x7efd500b35e0 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/3920215312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b35e0 msgr2=0x7efd500b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- 172.21.15.27:0/3920215312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b35e0 0x7efd500b7b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd50071dc0 tx=0x7efd3801ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/3920215312 shutdown_connections 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- 172.21.15.27:0/3920215312 >> v2:172.21.15.124:3300/0 conn(0x7efd500b70e0 0x7efd50153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- 172.21.15.27:0/3920215312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b35e0 0x7efd500b7b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.067 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/3920215312 >> 172.21.15.27:0/3920215312 conn(0x7efd500bbf80 msgr2=0x7efd500bc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.068 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/3920215312 shutdown_connections 2024-01-24T12:44:05.068 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/3920215312 wait complete. 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 Processor -- start 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- start start 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 0x7efd5013ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 0x7efd50148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50148350 con 0x7efd500b70e0 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5013cd40 con 0x7efd500b35e0 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50147980 con 0x7efd501468c0 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55500/0 (socket says 172.21.15.27:55500) 2024-01-24T12:44:05.070 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 -- 172.21.15.27:0/733600797 learned_addr learned my addr 172.21.15.27:0/733600797 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4ffff640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 0x7efd50148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 0x7efd5013ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 -- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 msgr2=0x7efd50148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 0x7efd50148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 -- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 msgr2=0x7efd5013ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 0x7efd5013ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 -- 172.21.15.27:0/733600797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380094d0 con 0x7efd500b70e0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 0x7efd5013ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4ffff640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 0x7efd50148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd47fff640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c4a0 tx=0x7efd4000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40005480 con 0x7efd500b70e0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40003600 con 0x7efd500b70e0 2024-01-24T12:44:05.071 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd50146d70 con 0x7efd500b70e0 2024-01-24T12:44:05.072 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400039b0 con 0x7efd500b70e0 2024-01-24T12:44:05.072 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.068+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd50147650 con 0x7efd500b70e0 2024-01-24T12:44:05.072 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50073790 con 0x7efd500b70e0 2024-01-24T12:44:05.073 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd40003b10 con 0x7efd500b70e0 2024-01-24T12:44:05.073 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd4cff9640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 0x7efd30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.073 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd40082420 con 0x7efd500b70e0 2024-01-24T12:44:05.073 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 0x7efd30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.073 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.072+0000 7efd4f7fe640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 0x7efd30067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd380b2000 tx=0x7efd380aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.076 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.076+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efd40050130 con 0x7efd500b70e0 2024-01-24T12:44:05.232 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.232+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd50147ac0 con 0x7efd500b70e0 2024-01-24T12:44:05.234 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd4cff9640 1 -- 172.21.15.27:0/733600797 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7efd40017020 con 0x7efd500b70e0 2024-01-24T12:44:05.234 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-24T12:44:05.235 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":16,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:01.857198+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:05.236 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 msgr2=0x7efd30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 0x7efd30067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd380b2000 tx=0x7efd380aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 msgr2=0x7efd50147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c4a0 tx=0x7efd4000c960 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 shutdown_connections 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd30065a60 0x7efd30067f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd501468c0 0x7efd50148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd500b70e0 0x7efd50147e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 --2- 172.21.15.27:0/733600797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd500b35e0 0x7efd5013ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 >> 172.21.15.27:0/733600797 conn(0x7efd500bbf80 msgr2=0x7efd500ba9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 shutdown_connections 2024-01-24T12:44:05.237 INFO:teuthology.misc.health.smithi027.stderr:2024-01-24T12:44:05.236+0000 7efd55c09640 1 -- 172.21.15.27:0/733600797 wait complete. 2024-01-24T12:44:05.253 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-24T12:44:05.253 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-24T12:44:05.253 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-24T12:44:05.253 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-24T12:44:05.255 INFO:tasks.ceph.mds.a:Started 2024-01-24T12:44:05.256 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-24T12:44:05.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-24T12:44:05.258 INFO:tasks.ceph.mds.c:Started 2024-01-24T12:44:05.259 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-24T12:44:05.259 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-24T12:44:05.262 INFO:tasks.ceph.mds.b:Started 2024-01-24T12:44:05.262 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-24T12:44:05.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:05.335 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-24T12:44:05.335 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-24T12:44:05.355 INFO:tasks.ceph.mds.b.smithi124.stdout:starting mds.b at 2024-01-24T12:44:05.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 Processor -- start 2024-01-24T12:44:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 -- start start 2024-01-24T12:44:05.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0aa414b540 0x7f0aa40bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa414edf0 con 0x7f0aa406a4c0 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40bc590 con 0x7f0aa406a900 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aaa833640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40bc320 con 0x7f0aa414b540 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0aa414b540 0x7f0aa40bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa37fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0aa406a4c0 0x7f0aa414dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49838/0 (socket says 172.21.15.27:49838) 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa37fe640 1 -- 172.21.15.27:0/3242590604 learned_addr learned my addr 172.21.15.27:0/3242590604 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0aa414b540 0x7f0aa40bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55522/0 (socket says 172.21.15.27:55522) 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa3fff640 1 -- 172.21.15.27:0/3242590604 >> v1:172.21.15.124:6789/0 conn(0x7f0aa406a900 legacy=0x7f0aa414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa3fff640 1 -- 172.21.15.27:0/3242590604 >> v1:172.21.15.27:6789/0 conn(0x7f0aa406a4c0 legacy=0x7f0aa414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.376+0000 7f0aa3fff640 1 -- 172.21.15.27:0/3242590604 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40b3a10 con 0x7f0aa414b540 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aa3fff640 1 --2- 172.21.15.27:0/3242590604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa414b540 0x7f0aa40bac60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097c0 tx=0x7f0a9401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c0c32a6d998ef0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aa2ffd640 1 -- 172.21.15.27:0/3242590604 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940a8970 con 0x7f0aa414b540 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aa2ffd640 1 -- 172.21.15.27:0/3242590604 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940a8ad0 con 0x7f0aa414b540 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aa2ffd640 1 -- 172.21.15.27:0/3242590604 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940a8e60 con 0x7f0aa414b540 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- 172.21.15.27:0/3242590604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa414b540 msgr2=0x7f0aa40bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 --2- 172.21.15.27:0/3242590604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa414b540 0x7f0aa40bac60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097c0 tx=0x7f0a9401ec70 comp rx=0 tx=0).stop 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- 172.21.15.27:0/3242590604 shutdown_connections 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 --2- 172.21.15.27:0/3242590604 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa414b540 0x7f0aa40bac60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- 172.21.15.27:0/3242590604 >> 172.21.15.27:0/3242590604 conn(0x7f0aa40c02e0 msgr2=0x7f0aa40c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- 172.21.15.27:0/3242590604 shutdown_connections 2024-01-24T12:44:05.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- 172.21.15.27:0/3242590604 wait complete. 2024-01-24T12:44:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 Processor -- start 2024-01-24T12:44:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.380+0000 7f0aaa833640 1 -- start start 2024-01-24T12:44:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0aa406a900 0x7f0aa40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0aa414b540 0x7f0aa40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa414d7a0 con 0x7f0aa406a4c0 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40a5a00 con 0x7f0aa414b540 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40b9d10 con 0x7f0aa406a900 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55528/0 (socket says 172.21.15.27:55528) 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 -- 172.21.15.27:0/2491572017 learned_addr learned my addr 172.21.15.27:0/2491572017 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa8dd0640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0aa414b540 0x7f0aa40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa37fe640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0aa406a900 0x7f0aa40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 -- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0aa406a900 msgr2=0x7f0aa40b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0aa406a900 0x7f0aa40b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 -- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0aa414b540 msgr2=0x7f0aa40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0aa414b540 0x7f0aa40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 -- 172.21.15.27:0/2491572017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009420 con 0x7f0aa406a4c0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa3fff640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a940b3040 tx=0x7f0a9401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940b9630 con 0x7f0aa406a4c0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940b97b0 con 0x7f0aa406a4c0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa40b9480 con 0x7f0aa406a4c0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940b9b60 con 0x7f0aa406a4c0 2024-01-24T12:44:05.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa40a5f30 con 0x7f0aa406a4c0 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa404e000 con 0x7f0aa406a4c0 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a940b7040 con 0x7f0aa406a4c0 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 0x7f0a90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a94120db0 con 0x7f0aa406a4c0 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa37fe640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 0x7f0a90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.384+0000 7f0aa37fe640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 0x7f0a90067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40a1d30 tx=0x7f0a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.388+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0a940eeac0 con 0x7f0aa406a4c0 2024-01-24T12:44:05.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.548+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa40a6260 con 0x7f0aa406a4c0 2024-01-24T12:44:05.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aa0ff9640 1 -- 172.21.15.27:0/2491572017 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f0a940b5090 con 0x7f0aa406a4c0 2024-01-24T12:44:05.551 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:05.551 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":16,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:01.857198+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:05.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 msgr2=0x7f0a90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 0x7f0a90067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40a1d30 tx=0x7f0a98009040 comp rx=0 tx=0).stop 2024-01-24T12:44:05.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 msgr2=0x7f0aa414d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a940b3040 tx=0x7f0a9401ba10 comp rx=0 tx=0).stop 2024-01-24T12:44:05.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 shutdown_connections 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0a90065a60 0x7f0a90067f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0aa414b540 0x7f0aa40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0aa406a900 0x7f0aa40b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 --2- 172.21.15.27:0/2491572017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0aa406a4c0 0x7f0aa414d260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 >> 172.21.15.27:0/2491572017 conn(0x7f0aa40c02e0 msgr2=0x7f0aa4149fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 shutdown_connections 2024-01-24T12:44:05.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.552+0000 7f0aaa833640 1 -- 172.21.15.27:0/2491572017 wait complete. 2024-01-24T12:44:05.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:05.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 Processor -- start 2024-01-24T12:44:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 -- start start 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8508142aa0 0x7f85080b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 0x7f8508070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8508071270 con 0x7f85080b6620 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85080b8820 con 0x7f8508142aa0 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850fd7b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080b7ed0 con 0x7f85080b39f0 2024-01-24T12:44:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850e318640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f85080b6620 0x7f850806d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49852/0 (socket says 172.21.15.27:49852) 2024-01-24T12:44:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850e318640 1 -- 172.21.15.27:0/2638086441 learned_addr learned my addr 172.21.15.27:0/2638086441 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850d316640 1 --2- 172.21.15.27:0/2638086441 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 0x7f8508070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850db17640 1 --2- 172.21.15.27:0/2638086441 >> v2:172.21.15.124:3300/0 conn(0x7f8508142aa0 0x7f85080b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850cb15640 1 -- 172.21.15.27:0/2638086441 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547108659 0 0) 0x7f8508071270 con 0x7f85080b6620 2024-01-24T12:44:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850cb15640 1 -- 172.21.15.27:0/2638086441 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003530 con 0x7f85080b6620 2024-01-24T12:44:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850d316640 1 -- 172.21.15.27:0/2638086441 >> v2:172.21.15.124:3300/0 conn(0x7f8508142aa0 msgr2=0x7f85080b9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850d316640 1 --2- 172.21.15.27:0/2638086441 >> v2:172.21.15.124:3300/0 conn(0x7f8508142aa0 0x7f85080b9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850d316640 1 -- 172.21.15.27:0/2638086441 >> v1:172.21.15.27:6789/0 conn(0x7f85080b6620 legacy=0x7f850806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.700+0000 7f850d316640 1 -- 172.21.15.27:0/2638086441 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080b7910 con 0x7f85080b39f0 2024-01-24T12:44:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850d316640 1 --2- 172.21.15.27:0/2638086441 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 0x7f8508070d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648e48aae051f02c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850cb15640 1 -- 172.21.15.27:0/2638086441 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80a8970 con 0x7f85080b39f0 2024-01-24T12:44:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850cb15640 1 -- 172.21.15.27:0/2638086441 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80a8ad0 con 0x7f85080b39f0 2024-01-24T12:44:05.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850cb15640 1 -- 172.21.15.27:0/2638086441 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80a8e40 con 0x7f85080b39f0 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- 172.21.15.27:0/2638086441 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 msgr2=0x7f8508070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 --2- 172.21.15.27:0/2638086441 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 0x7f8508070d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801ec70 comp rx=0 tx=0).stop 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- 172.21.15.27:0/2638086441 shutdown_connections 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 --2- 172.21.15.27:0/2638086441 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f85080b39f0 0x7f8508070d30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 --2- 172.21.15.27:0/2638086441 >> v2:172.21.15.124:3300/0 conn(0x7f8508142aa0 0x7f85080b9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- 172.21.15.27:0/2638086441 >> 172.21.15.27:0/2638086441 conn(0x7f85080bcf90 msgr2=0x7f85080bd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- 172.21.15.27:0/2638086441 shutdown_connections 2024-01-24T12:44:05.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- 172.21.15.27:0/2638086441 wait complete. 2024-01-24T12:44:05.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 Processor -- start 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.704+0000 7f850fd7b640 1 -- start start 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 0x7f85081d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 0x7f85081d3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85081d4c10 con 0x7f85080b6620 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85081d38a0 con 0x7f85080b39f0 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080b4610 con 0x7f8508142aa0 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55534/0 (socket says 172.21.15.27:55534) 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 -- 172.21.15.27:0/1543918062 learned_addr learned my addr 172.21.15.27:0/1543918062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850e318640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 0x7f85081d3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850db17640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 0x7f85081d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 -- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 msgr2=0x7f85081d3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 0x7f85081d3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 -- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 msgr2=0x7f85081d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 0x7f85081d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 -- 172.21.15.27:0/1543918062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8009420 con 0x7f85080b6620 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850e318640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 0x7f85081d3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850db17640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 0x7f85081d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850d316640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84f801c8a0 tx=0x7f84f801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80b0d40 con 0x7f85080b6620 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80b9430 con 0x7f85080b6620 2024-01-24T12:44:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8508147a30 con 0x7f85080b6620 2024-01-24T12:44:05.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80b0ea0 con 0x7f85080b6620 2024-01-24T12:44:05.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85081d3530 con 0x7f85080b6620 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f84f80b7040 con 0x7f85080b6620 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85080b6440 con 0x7f85080b6620 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 0x7f84ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84f81209a0 con 0x7f85080b6620 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.708+0000 7f850db17640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 0x7f84ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:05.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.712+0000 7f850db17640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 0x7f84ec067f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8504009a40 tx=0x7f8504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:05.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.712+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f84f80ee6a0 con 0x7f85080b6620 2024-01-24T12:44:05.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.868+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f850804e000 con 0x7f85080b6620 2024-01-24T12:44:05.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f84fe7fc640 1 -- 172.21.15.27:0/1543918062 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84f80b5020 con 0x7f85080b6620 2024-01-24T12:44:05.870 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 msgr2=0x7f84ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 0x7f84ec067f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8504009a40 tx=0x7f8504008040 comp rx=0 tx=0).stop 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 msgr2=0x7f85081d5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84f801c8a0 tx=0x7f84f801ba10 comp rx=0 tx=0).stop 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 shutdown_connections 2024-01-24T12:44:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f84ec065a60 0x7f84ec067f20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8508142aa0 0x7f85081d3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f85080b6620 0x7f85081d5000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 --2- 172.21.15.27:0/1543918062 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f85080b39f0 0x7f85081d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 >> 172.21.15.27:0/1543918062 conn(0x7f85080bcf90 msgr2=0x7f85080bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 shutdown_connections 2024-01-24T12:44:05.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:05.872+0000 7f850fd7b640 1 -- 172.21.15.27:0/1543918062 wait complete. 2024-01-24T12:44:05.890 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.016+0000 7f8457748640 1 Processor -- start 2024-01-24T12:44:06.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.016+0000 7f8457748640 1 -- start start 2024-01-24T12:44:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8457748640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8450071a20 0x7f8450070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8457748640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f84501440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8457748640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500b2c80 con 0x7f84500708d0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8457748640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006fdb0 con 0x7f8450071a20 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8457748640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8450070370 con 0x7f8450147920 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f84554e4640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f84500708d0 0x7f8450147210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49862/0 (socket says 172.21.15.27:49862) 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f84554e4640 1 -- 172.21.15.27:0/4082298298 learned_addr learned my addr 172.21.15.27:0/4082298298 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 --2- 172.21.15.27:0/4082298298 >> v2:172.21.15.124:3300/0 conn(0x7f8450071a20 0x7f8450070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8455ce5640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f84501440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106672167 0 0) 0x7f84500b2c80 con 0x7f84500708d0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003530 con 0x7f84500708d0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2819852636 0 0) 0x7f843c003530 con 0x7f84500708d0 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 msgr2=0x7f84501440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f84501440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 >> v2:172.21.15.124:3300/0 conn(0x7f8450071a20 msgr2=0x7f8450070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 --2- 172.21.15.27:0/4082298298 >> v2:172.21.15.124:3300/0 conn(0x7f8450071a20 0x7f8450070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500b2ed0 con 0x7f84500708d0 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f844c001680 con 0x7f84500708d0 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 >> v1:172.21.15.27:6789/0 conn(0x7f84500708d0 legacy=0x7f8450147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f843c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845006fdb0 con 0x7f843c0047d0 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450070370 con 0x7f843c003980 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00b990 con 0x7f8450147920 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f84554e4640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8455ce5640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f843c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 -- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 msgr2=0x7f843c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f843c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 -- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f843c003980 msgr2=0x7f843c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f843c003980 0x7f843c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8454ce3640 1 -- 172.21.15.27:0/4082298298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c003530 con 0x7f843c0047d0 2024-01-24T12:44:06.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.020+0000 7f8455ce5640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450147920 0x7f843c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:06.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8454ce3640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ae0 tx=0x7f844001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca11e8dd935a084a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400a64a0 con 0x7f843c0047d0 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84400a6600 con 0x7f843c0047d0 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8447fff640 1 -- 172.21.15.27:0/4082298298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400a69b0 con 0x7f843c0047d0 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- 172.21.15.27:0/4082298298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 msgr2=0x7f843c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 --2- 172.21.15.27:0/4082298298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f843c004c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ae0 tx=0x7f844001ca90 comp rx=0 tx=0).stop 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8455ce5640 1 -- 172.21.15.27:0/4082298298 reap_dead start 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- 172.21.15.27:0/4082298298 shutdown_connections 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- 172.21.15.27:0/4082298298 >> 172.21.15.27:0/4082298298 conn(0x7f8450069ef0 msgr2=0x7f845006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- 172.21.15.27:0/4082298298 shutdown_connections 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- 172.21.15.27:0/4082298298 wait complete. 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 Processor -- start 2024-01-24T12:44:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- start start 2024-01-24T12:44:06.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 0x7f8450138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84501389d0 0x7f8450135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450136d60 con 0x7f843c0047d0 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450138e60 con 0x7f84501389d0 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8457748640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845013b2b0 con 0x7f8450134130 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55546/0 (socket says 172.21.15.27:55546) 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 -- 172.21.15.27:0/3102828736 learned_addr learned my addr 172.21.15.27:0/3102828736 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8455ce5640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84501389d0 0x7f8450135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8454ce3640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 0x7f8450138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 -- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 msgr2=0x7f8450138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 0x7f8450138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 -- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84501389d0 msgr2=0x7f8450135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84501389d0 0x7f8450135300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f84554e4640 1 -- 172.21.15.27:0/3102828736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845013b590 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.024+0000 7f8454ce3640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 0x7f8450138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f84554e4640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f844c011840 tx=0x7f844c011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00fae0 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00fc40 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845013b870 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c015410 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8450139ef0 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845004e000 con 0x7f843c0047d0 2024-01-24T12:44:06.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f844c015590 con 0x7f843c0047d0 2024-01-24T12:44:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 0x7f8434067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f844c0860e0 con 0x7f843c0047d0 2024-01-24T12:44:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8454ce3640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 0x7f8434067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:06.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.028+0000 7f8454ce3640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 0x7f8434067f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84400ad000 tx=0x7f84400046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:06.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.032+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f844c053df0 con 0x7f843c0047d0 2024-01-24T12:44:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8450147e30 con 0x7f843c0047d0 2024-01-24T12:44:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8445ffb640 1 -- 172.21.15.27:0/3102828736 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f844c001600 con 0x7f843c0047d0 2024-01-24T12:44:06.224 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:06.224 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-01-24T12:44:06.224 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 2 2024-01-24T12:44:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 msgr2=0x7f8434067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 0x7f8434067f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84400ad000 tx=0x7f84400046d0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 msgr2=0x7f8450133bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f844c011840 tx=0x7f844c011d00 comp rx=0 tx=0).stop 2024-01-24T12:44:06.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 shutdown_connections 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8434065a90 0x7f8434067f50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84501389d0 0x7f8450135300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8450134130 0x7f8450138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 --2- 172.21.15.27:0/3102828736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f843c0047d0 0x7f8450133bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 >> 172.21.15.27:0/3102828736 conn(0x7f8450069ef0 msgr2=0x7f84500bc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.224+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 shutdown_connections 2024-01-24T12:44:06.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:06.228+0000 7f8457748640 1 -- 172.21.15.27:0/3102828736 wait complete. 2024-01-24T12:44:08.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:08.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 Processor -- start 2024-01-24T12:44:08.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 -- start start 2024-01-24T12:44:08.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 0x7fe78006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe7801532f0 0x7fe7801556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800bb370 con 0x7fe78014b540 2024-01-24T12:44:08.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78006ae40 con 0x7fe7801532f0 2024-01-24T12:44:08.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe787b93640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800bc320 con 0x7fe78006a4c0 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78592f640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe78014b540 0x7fe7800bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49878/0 (socket says 172.21.15.27:49878) 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78592f640 1 -- 172.21.15.27:0/2199937825 learned_addr learned my addr 172.21.15.27:0/2199937825 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 0x7fe78006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817124132 0 0) 0x7fe7800bb370 con 0x7fe78014b540 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe76c003530 con 0x7fe78014b540 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe786130640 1 --2- 172.21.15.27:0/2199937825 >> v2:172.21.15.124:3300/0 conn(0x7fe7801532f0 0x7fe7801556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1808659880 0 0) 0x7fe76c003530 con 0x7fe78014b540 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 msgr2=0x7fe78006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 0x7fe78006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 >> v2:172.21.15.124:3300/0 conn(0x7fe7801532f0 msgr2=0x7fe7801556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 --2- 172.21.15.27:0/2199937825 >> v2:172.21.15.124:3300/0 conn(0x7fe7801532f0 0x7fe7801556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800bc590 con 0x7fe78014b540 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fe770001680 con 0x7fe78014b540 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 >> v1:172.21.15.27:6789/0 conn(0x7fe78014b540 legacy=0x7fe7800bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 0x7fe76c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe76c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe76c004d10 0x7fe76c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78006ae40 con 0x7fe76c003f00 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c00b9f0 con 0x7fe76c004d10 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c00bbb0 con 0x7fe78006a4c0 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe76c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe786130640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe76c004d10 0x7fe76c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 -- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 msgr2=0x7fe76c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe78006a4c0 0x7fe76c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 -- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe76c004d10 msgr2=0x7fe76c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe76c004d10 0x7fe76c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.380+0000 7fe78512e640 1 -- 172.21.15.27:0/2199937825 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c003530 con 0x7fe76c003f00 2024-01-24T12:44:08.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78512e640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe76c0047d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ae0 tx=0x7fe77c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d5911b24fd6adc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0a5680 con 0x7fe76c003f00 2024-01-24T12:44:08.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0a57e0 con 0x7fe76c003f00 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78492d640 1 -- 172.21.15.27:0/2199937825 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0a5b90 con 0x7fe76c003f00 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- 172.21.15.27:0/2199937825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 msgr2=0x7fe76c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 --2- 172.21.15.27:0/2199937825 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe76c0047d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ae0 tx=0x7fe77c01ca90 comp rx=0 tx=0).stop 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe786130640 1 -- 172.21.15.27:0/2199937825 reap_dead start 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- 172.21.15.27:0/2199937825 shutdown_connections 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- 172.21.15.27:0/2199937825 >> 172.21.15.27:0/2199937825 conn(0x7fe7800c02e0 msgr2=0x7fe7800c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- 172.21.15.27:0/2199937825 shutdown_connections 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- 172.21.15.27:0/2199937825 wait complete. 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 Processor -- start 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- start start 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 0x7fe7801e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe7800b1b80 0x7fe7800b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801e3c90 con 0x7fe76c003f00 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800b6ae0 con 0x7fe7800b3eb0 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe787b93640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800b46e0 con 0x7fe7800b1b80 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55562/0 (socket says 172.21.15.27:55562) 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 -- 172.21.15.27:0/1720885298 learned_addr learned my addr 172.21.15.27:0/1720885298 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78512e640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 0x7fe7801e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe786130640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe7800b1b80 0x7fe7800b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 -- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe7800b1b80 msgr2=0x7fe7800b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe7800b1b80 0x7fe7800b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 -- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 msgr2=0x7fe7801e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 0x7fe7801e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 -- 172.21.15.27:0/1720885298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7801e3920 con 0x7fe76c003f00 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78512e640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 0x7fe7801e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:08.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe78592f640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe770001830 tx=0x7fe77000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.384+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700074e0 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770007660 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7800b49c0 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770004a30 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7801e4660 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7800a1a90 con 0x7fe76c003f00 2024-01-24T12:44:08.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe770004b90 con 0x7fe76c003f00 2024-01-24T12:44:08.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe7767fc640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 0x7fe764067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe770082300 con 0x7fe76c003f00 2024-01-24T12:44:08.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe78512e640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 0x7fe764067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.388+0000 7fe78512e640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 0x7fe764067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0af000 tx=0x7fe77c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.392+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe770050000 con 0x7fe76c003f00 2024-01-24T12:44:08.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7801e3ab0 con 0x7fe76c003f00 2024-01-24T12:44:08.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe7767fc640 1 -- 172.21.15.27:0/1720885298 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2771 (secure 0 0 0) 0x7fe770018af0 con 0x7fe76c003f00 2024-01-24T12:44:08.583 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:08.583 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-24T12:44:08.584 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 msgr2=0x7fe764067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 0x7fe764067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0af000 tx=0x7fe77c0046d0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 msgr2=0x7fe7800b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe770001830 tx=0x7fe77000cc20 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 shutdown_connections 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe764065a60 0x7fe764067f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe7800b1b80 0x7fe7800b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7800b3eb0 0x7fe7801e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 --2- 172.21.15.27:0/1720885298 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe76c003f00 0x7fe7800b65a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 >> 172.21.15.27:0/1720885298 conn(0x7fe7800c02e0 msgr2=0x7fe7800a1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 shutdown_connections 2024-01-24T12:44:08.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.584+0000 7fe787b93640 1 -- 172.21.15.27:0/1720885298 wait complete. 2024-01-24T12:44:08.603 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 Processor -- start 2024-01-24T12:44:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 -- start start 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96e80bc340 0x7f96e8142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e8142d50 0x7f96e8148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f96e81492a0 0x7f96e80b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e8071770 con 0x7f96e80bc340 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e81496d0 con 0x7f96e81492a0 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96eeb23640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80b37e0 con 0x7f96e8142d50 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96e80bc340 0x7f96e8142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f96e80bc340 0x7f96e8142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55574/0 (socket says 172.21.15.27:55574) 2024-01-24T12:44:08.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 -- 172.21.15.27:0/1152571001 learned_addr learned my addr 172.21.15.27:0/1152571001 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96e7fff640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e8142d50 0x7f96e8148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ed0c0640 1 --2- 172.21.15.27:0/1152571001 >> v2:172.21.15.124:3300/0 conn(0x7f96e81492a0 0x7f96e80b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 -- 172.21.15.27:0/1152571001 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e8142d50 msgr2=0x7f96e8148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e8142d50 0x7f96e8148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 -- 172.21.15.27:0/1152571001 >> v2:172.21.15.124:3300/0 conn(0x7f96e81492a0 msgr2=0x7f96e80b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/1152571001 >> v2:172.21.15.124:3300/0 conn(0x7f96e81492a0 0x7f96e80b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 -- 172.21.15.27:0/1152571001 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80b3ac0 con 0x7f96e80bc340 2024-01-24T12:44:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e80bc340 0x7f96e8142810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96e80b9d60 tx=0x7f96d001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fec4702e2d7602 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96e77fe640 1 -- 172.21.15.27:0/1152571001 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00a89b0 con 0x7f96e80bc340 2024-01-24T12:44:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96e77fe640 1 -- 172.21.15.27:0/1152571001 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00a8b10 con 0x7f96e80bc340 2024-01-24T12:44:08.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.728+0000 7f96e77fe640 1 -- 172.21.15.27:0/1152571001 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00a8ea0 con 0x7f96e80bc340 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/1152571001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e80bc340 msgr2=0x7f96e8142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e80bc340 0x7f96e8142810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96e80b9d60 tx=0x7f96d001ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/1152571001 shutdown_connections 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- 172.21.15.27:0/1152571001 >> v2:172.21.15.124:3300/0 conn(0x7f96e81492a0 0x7f96e80b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e8142d50 0x7f96e8148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- 172.21.15.27:0/1152571001 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e80bc340 0x7f96e8142810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/1152571001 >> 172.21.15.27:0/1152571001 conn(0x7f96e8069ef0 msgr2=0x7f96e806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/1152571001 shutdown_connections 2024-01-24T12:44:08.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/1152571001 wait complete. 2024-01-24T12:44:08.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 Processor -- start 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- start start 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96e80bc340 0x7f96e806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e81492a0 0x7f96e80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8147820 con 0x7f96e806eca0 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8070d20 con 0x7f96e80bc340 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81474d0 con 0x7f96e81492a0 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55582/0 (socket says 172.21.15.27:55582) 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 -- 172.21.15.27:0/2211102927 learned_addr learned my addr 172.21.15.27:0/2211102927 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96e80bc340 0x7f96e806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96e7fff640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e81492a0 0x7f96e80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 -- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e81492a0 msgr2=0x7f96e80707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e81492a0 0x7f96e80707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 -- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96e80bc340 msgr2=0x7f96e806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96e80bc340 0x7f96e806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 -- 172.21.15.27:0/2211102927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00094d0 con 0x7f96e806eca0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96ed0c0640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007e40 tx=0x7f96e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0014620 con 0x7f96e806eca0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000ee90 con 0x7f96e806eca0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8139730 con 0x7f96e806eca0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00149e0 con 0x7f96e806eca0 2024-01-24T12:44:08.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.732+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e813a830 con 0x7f96e806eca0 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e804e000 con 0x7f96e806eca0 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96e0014b40 con 0x7f96e806eca0 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96e57fa640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 0x7f96c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96e0083740 con 0x7f96e806eca0 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 0x7f96c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:08.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.736+0000 7f96ec8bf640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 0x7f96c8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96d00b2000 tx=0x7f96d00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:08.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.740+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f96e0051450 con 0x7f96e806eca0 2024-01-24T12:44:08.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.896+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e80b4cb0 con 0x7f96e806eca0 2024-01-24T12:44:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96e57fa640 1 -- 172.21.15.27:0/2211102927 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f96e0054a70 con 0x7f96e806eca0 2024-01-24T12:44:08.899 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":16,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:01.857198+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 msgr2=0x7f96c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 0x7f96c8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96d00b2000 tx=0x7f96d00aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 msgr2=0x7f96e813ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007e40 tx=0x7f96e000e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 shutdown_connections 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f96c8065a60 0x7f96c8067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f96e806eca0 0x7f96e813ad30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f96e81492a0 0x7f96e80707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 --2- 172.21.15.27:0/2211102927 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f96e80bc340 0x7f96e806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 >> 172.21.15.27:0/2211102927 conn(0x7f96e8069ef0 msgr2=0x7f96e80ba930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 shutdown_connections 2024-01-24T12:44:08.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:08.900+0000 7f96eeb23640 1 -- 172.21.15.27:0/2211102927 wait complete. 2024-01-24T12:44:08.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:08.919 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:09.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 Processor -- start 2024-01-24T12:44:09.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 -- start start 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32b806af90 0x7f32b8148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b8145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b8071850 con 0x7f32b814be30 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80b53f0 con 0x7f32b806af90 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32bd696640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b4720 con 0x7f32b81458f0 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32b6ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f32b806af90 0x7f32b8148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32b77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f32b814be30 0x7f32b814c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49880/0 (socket says 172.21.15.27:49880) 2024-01-24T12:44:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32b77fe640 1 -- 172.21.15.27:0/2016219387 learned_addr learned my addr 172.21.15.27:0/2016219387 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32affff640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b8145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32b6ffd640 1 -- 172.21.15.27:0/2016219387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 msgr2=0x7f32b8145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.044+0000 7f32b6ffd640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b8145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b6ffd640 1 -- 172.21.15.27:0/2016219387 >> v1:172.21.15.27:6789/0 conn(0x7f32b814be30 legacy=0x7f32b814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b6ffd640 1 -- 172.21.15.27:0/2016219387 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80b8950 con 0x7f32b806af90 2024-01-24T12:44:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b67fc640 1 -- 172.21.15.27:0/2016219387 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994644837 0 0) 0x7f32b8071850 con 0x7f32b814be30 2024-01-24T12:44:09.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b6ffd640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b806af90 0x7f32b8148900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097c0 tx=0x7f32a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d3acdb40a6bf97 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b67fc640 1 -- 172.21.15.27:0/2016219387 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80ab600 con 0x7f32b806af90 2024-01-24T12:44:09.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b67fc640 1 -- 172.21.15.27:0/2016219387 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a80a7050 con 0x7f32b806af90 2024-01-24T12:44:09.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32b67fc640 1 -- 172.21.15.27:0/2016219387 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80ab980 con 0x7f32b806af90 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 -- 172.21.15.27:0/2016219387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b806af90 msgr2=0x7f32b8148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b806af90 0x7f32b8148900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32a80097c0 tx=0x7f32a801c480 comp rx=0 tx=0).stop 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 -- 172.21.15.27:0/2016219387 shutdown_connections 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b8145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 --2- 172.21.15.27:0/2016219387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b806af90 0x7f32b8148900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 -- 172.21.15.27:0/2016219387 >> 172.21.15.27:0/2016219387 conn(0x7f32b80b9140 msgr2=0x7f32b80b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 -- 172.21.15.27:0/2016219387 shutdown_connections 2024-01-24T12:44:09.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.048+0000 7f32bd696640 1 -- 172.21.15.27:0/2016219387 wait complete. 2024-01-24T12:44:09.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 Processor -- start 2024-01-24T12:44:09.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- start start 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32b806af90 0x7f32b80b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b81e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8070c20 con 0x7f32b814be30 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b2970 con 0x7f32b806af90 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b2c50 con 0x7f32b81458f0 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55590/0 (socket says 172.21.15.27:55590) 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 -- 172.21.15.27:0/468900572 learned_addr learned my addr 172.21.15.27:0/468900572 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32affff640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b81e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b6ffd640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32b806af90 0x7f32b80b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 -- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 msgr2=0x7f32b81e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b81e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 -- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32b806af90 msgr2=0x7f32b80b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32b806af90 0x7f32b80b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 -- 172.21.15.27:0/468900572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009420 con 0x7f32b814be30 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32b77fe640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c780 tx=0x7f32b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000ce90 con 0x7f32b814be30 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b000a640 con 0x7f32b814be30 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b80b0370 con 0x7f32b814be30 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000a9d0 con 0x7f32b814be30 2024-01-24T12:44:09.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b80b2660 con 0x7f32b814be30 2024-01-24T12:44:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.052+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8067050 con 0x7f32b814be30 2024-01-24T12:44:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.056+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32b000ab30 con 0x7f32b814be30 2024-01-24T12:44:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.056+0000 7f32af7fe640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 0x7f3298067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.056+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32b0082290 con 0x7f32b814be30 2024-01-24T12:44:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.056+0000 7f32b6ffd640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 0x7f3298067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.056+0000 7f32b6ffd640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 0x7f3298067f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32a80ad000 tx=0x7f32a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.060+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f32b004ffa0 con 0x7f32b814be30 2024-01-24T12:44:09.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.216+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32b804e000 con 0x7f32b814be30 2024-01-24T12:44:09.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.216+0000 7f32af7fe640 1 -- 172.21.15.27:0/468900572 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32b00535c0 con 0x7f32b814be30 2024-01-24T12:44:09.217 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 msgr2=0x7f3298067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 0x7f3298067f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32a80ad000 tx=0x7f32a80a6000 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 msgr2=0x7f32b81e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c780 tx=0x7f32b000cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 shutdown_connections 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3298065a90 0x7f3298067f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32b814be30 0x7f32b81e6070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f32b81458f0 0x7f32b81e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 --2- 172.21.15.27:0/468900572 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f32b806af90 0x7f32b80b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 >> 172.21.15.27:0/468900572 conn(0x7f32b80b9140 msgr2=0x7f32b8147ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 shutdown_connections 2024-01-24T12:44:09.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.220+0000 7f32bd696640 1 -- 172.21.15.27:0/468900572 wait complete. 2024-01-24T12:44:09.237 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T12:44:09.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.352+0000 7ff8db845640 1 Processor -- start 2024-01-24T12:44:09.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.352+0000 7ff8db845640 1 -- start start 2024-01-24T12:44:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d40bc340 0x7ff8d4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8d4149470 0x7ff8d4153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d4071770 con 0x7ff8d4142d50 2024-01-24T12:44:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d40b37e0 con 0x7ff8d4149470 2024-01-24T12:44:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40b3ac0 con 0x7ff8d40bc340 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff8d4149470 0x7ff8d4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d8de0640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff8d4142d50 0x7ff8d4148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:49886/0 (socket says 172.21.15.27:49886) 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d8de0640 1 -- 172.21.15.27:0/3901531118 learned_addr learned my addr 172.21.15.27:0/3901531118 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d95e1640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d40bc340 0x7ff8d4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 -- 172.21.15.27:0/3901531118 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d40bc340 msgr2=0x7ff8d4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d40bc340 0x7ff8d4142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 -- 172.21.15.27:0/3901531118 >> v1:172.21.15.27:6789/0 conn(0x7ff8d4142d50 legacy=0x7ff8d4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8cbfff640 1 -- 172.21.15.27:0/3901531118 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357696828 0 0) 0x7ff8d4071770 con 0x7ff8d4142d50 2024-01-24T12:44:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 -- 172.21.15.27:0/3901531118 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40b3da0 con 0x7ff8d4149470 2024-01-24T12:44:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8d9de2640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d4149470 0x7ff8d4153110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009d90 tx=0x7ff8cc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee1868c150d9b1a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8cbfff640 1 -- 172.21.15.27:0/3901531118 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0af600 con 0x7ff8d4149470 2024-01-24T12:44:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8cbfff640 1 -- 172.21.15.27:0/3901531118 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc0ab050 con 0x7ff8d4149470 2024-01-24T12:44:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8cbfff640 1 -- 172.21.15.27:0/3901531118 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0af980 con 0x7ff8d4149470 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- 172.21.15.27:0/3901531118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d4149470 msgr2=0x7ff8d4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d4149470 0x7ff8d4153110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009d90 tx=0x7ff8cc01f130 comp rx=0 tx=0).stop 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- 172.21.15.27:0/3901531118 shutdown_connections 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d4149470 0x7ff8d4153110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 --2- 172.21.15.27:0/3901531118 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d40bc340 0x7ff8d4142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.356+0000 7ff8db845640 1 -- 172.21.15.27:0/3901531118 >> 172.21.15.27:0/3901531118 conn(0x7ff8d4069ef0 msgr2=0x7ff8d406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- 172.21.15.27:0/3901531118 shutdown_connections 2024-01-24T12:44:09.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- 172.21.15.27:0/3901531118 wait complete. 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 Processor -- start 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- start start 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 0x7ff8d4146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 0x7ff8d413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d41470d0 con 0x7ff8d40bc340 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40bac70 con 0x7ff8d40bb9a0 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40b9fa0 con 0x7ff8d4149470 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55616/0 (socket says 172.21.15.27:55616) 2024-01-24T12:44:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 -- 172.21.15.27:0/2488245625 learned_addr learned my addr 172.21.15.27:0/2488245625 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d9de2640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 0x7ff8d413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d8de0640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 0x7ff8d4146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 -- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 msgr2=0x7ff8d4146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 0x7ff8d4146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 -- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 msgr2=0x7ff8d413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 0x7ff8d413d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 -- 172.21.15.27:0/2488245625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc009a70 con 0x7ff8d40bc340 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d8de0640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 0x7ff8d4146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d9de2640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 0x7ff8d413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8d95e1640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400b6c0 con 0x7ff8d40bc340 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400b820 con 0x7ff8d40bc340 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d40baec0 con 0x7ff8d40bc340 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400bb90 con 0x7ff8d40bc340 2024-01-24T12:44:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d40bb480 con 0x7ff8d40bc340 2024-01-24T12:44:09.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.360+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d40bb640 con 0x7ff8d40bc340 2024-01-24T12:44:09.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.364+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8c400bcf0 con 0x7ff8d40bc340 2024-01-24T12:44:09.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.364+0000 7ff8c9ffb640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 0x7ff8b8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.364+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8c40832b0 con 0x7ff8d40bc340 2024-01-24T12:44:09.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.364+0000 7ff8d8de0640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 0x7ff8b8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.364+0000 7ff8d8de0640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 0x7ff8b8067f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8d413f0b0 tx=0x7ff8d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.368+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff8c4051050 con 0x7ff8d40bc340 2024-01-24T12:44:09.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.520+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff8d404e000 con 0x7ff8d40bc340 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.520+0000 7ff8c9ffb640 1 -- 172.21.15.27:0/2488245625 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff8c4054670 con 0x7ff8d40bc340 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:09.522 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 msgr2=0x7ff8b8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 0x7ff8b8067f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8d413f0b0 tx=0x7ff8d0009040 comp rx=0 tx=0).stop 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 msgr2=0x7ff8d41481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 shutdown_connections 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff8b8065a90 0x7ff8b8067f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff8d40bb9a0 0x7ff8d413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff8d4149470 0x7ff8d4146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 --2- 172.21.15.27:0/2488245625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8d40bc340 0x7ff8d41481d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 >> 172.21.15.27:0/2488245625 conn(0x7ff8d4069ef0 msgr2=0x7ff8d40b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 shutdown_connections 2024-01-24T12:44:09.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.524+0000 7ff8db845640 1 -- 172.21.15.27:0/2488245625 wait complete. 2024-01-24T12:44:09.540 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T12:44:09.540 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T12:44:09.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 Processor -- start 2024-01-24T12:44:09.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 -- start start 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9a006af90 0x7ff9a0148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a0151150 0x7ff9a0153540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a0071850 con 0x7ff9a01458f0 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00b53f0 con 0x7ff9a006af90 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a772c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b4720 con 0x7ff9a0151150 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9a006af90 0x7ff9a0148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9a006af90 0x7ff9a0148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55622/0 (socket says 172.21.15.27:55622) 2024-01-24T12:44:09.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 -- 172.21.15.27:0/3501784357 learned_addr learned my addr 172.21.15.27:0/3501784357 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:09.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a5cc9640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a0151150 0x7ff9a0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 -- 172.21.15.27:0/3501784357 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a0151150 msgr2=0x7ff9a0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:09.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a0151150 0x7ff9a0153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 -- 172.21.15.27:0/3501784357 >> v1:172.21.15.124:6789/0 conn(0x7ff9a01458f0 legacy=0x7ff9a0145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:09.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.656+0000 7ff9a54c8640 1 -- 172.21.15.27:0/3501784357 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00b8950 con 0x7ff9a006af90 2024-01-24T12:44:09.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a006af90 0x7ff9a0148900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fdf2c902a5b56c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff997fff640 1 -- 172.21.15.27:0/3501784357 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0ac410 con 0x7ff9a006af90 2024-01-24T12:44:09.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff997fff640 1 -- 172.21.15.27:0/3501784357 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0ac570 con 0x7ff9a006af90 2024-01-24T12:44:09.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff997fff640 1 -- 172.21.15.27:0/3501784357 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0ac900 con 0x7ff9a006af90 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- 172.21.15.27:0/3501784357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a006af90 msgr2=0x7ff9a0148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a006af90 0x7ff9a0148900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009870 tx=0x7ff99c01c500 comp rx=0 tx=0).stop 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- 172.21.15.27:0/3501784357 shutdown_connections 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a0151150 0x7ff9a0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- 172.21.15.27:0/3501784357 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a006af90 0x7ff9a0148900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- 172.21.15.27:0/3501784357 >> 172.21.15.27:0/3501784357 conn(0x7ff9a00b9140 msgr2=0x7ff9a00b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- 172.21.15.27:0/3501784357 shutdown_connections 2024-01-24T12:44:09.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- 172.21.15.27:0/3501784357 wait complete. 2024-01-24T12:44:09.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 Processor -- start 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- start start 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 0x7ff9a00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a01458f0 0x7ff9a01e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a014be40 con 0x7ff9a0151150 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b2bb0 con 0x7ff9a006af90 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.660+0000 7ff9a772c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a014b7c0 con 0x7ff9a01458f0 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55628/0 (socket says 172.21.15.27:55628) 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 -- 172.21.15.27:0/2135527378 learned_addr learned my addr 172.21.15.27:0/2135527378 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:09.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a4cc7640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a01458f0 0x7ff9a01e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 0x7ff9a00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 -- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a01458f0 msgr2=0x7ff9a01e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a01458f0 0x7ff9a01e06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 -- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 msgr2=0x7ff9a00b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 0x7ff9a00b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 -- 172.21.15.27:0/2135527378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0094d0 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 0x7ff9a00b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a5cc9640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff998007e10 tx=0x7ff99800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998014620 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980147a0 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998014b50 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0142140 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a014ba60 con 0x7ff9a0151150 2024-01-24T12:44:09.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a014bc20 con 0x7ff9a0151150 2024-01-24T12:44:09.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff998014cb0 con 0x7ff9a0151150 2024-01-24T12:44:09.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 0x7ff984067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:09.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff998083760 con 0x7ff9a0151150 2024-01-24T12:44:09.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 0x7ff984067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:09.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.664+0000 7ff9a54c8640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 0x7ff984067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0ae000 tx=0x7ff99c0a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:09.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.668+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff998051470 con 0x7ff9a0151150 2024-01-24T12:44:09.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.816+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9a014bf80 con 0x7ff9a0151150 2024-01-24T12:44:09.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.904+0000 7ff995ffb640 1 -- 172.21.15.27:0/2135527378 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9a014bf80 con 0x7ff9a0151150 2024-01-24T12:44:09.903 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-01-24T12:44:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 msgr2=0x7ff984067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 0x7ff984067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0ae000 tx=0x7ff99c0a6040 comp rx=0 tx=0).stop 2024-01-24T12:44:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 msgr2=0x7ff9a01e0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff998007e10 tx=0x7ff99800e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 shutdown_connections 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff984065a60 0x7ff984067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9a0151150 0x7ff9a01e0c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9a01458f0 0x7ff9a01e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 --2- 172.21.15.27:0/2135527378 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9a006af90 0x7ff9a00b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 >> 172.21.15.27:0/2135527378 conn(0x7ff9a00b9140 msgr2=0x7ff9a00b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 shutdown_connections 2024-01-24T12:44:09.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:09.908+0000 7ff9a772c640 1 -- 172.21.15.27:0/2135527378 wait complete. 2024-01-24T12:44:09.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T12:44:10.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 Processor -- start 2024-01-24T12:44:10.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 -- start start 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a0c144a80 0x7f6a0c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6a0c144f10 0x7f6a0c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c0b6e80 con 0x7f6a0c0b8b40 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0b7160 con 0x7f6a0c144a80 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a10ef6640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0bc6c0 con 0x7f6a0c144f10 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a0c144a80 0x7f6a0c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6a0c144a80 0x7f6a0c14ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55644/0 (socket says 172.21.15.27:55644) 2024-01-24T12:44:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 -- 172.21.15.27:0/3159321196 learned_addr learned my addr 172.21.15.27:0/3159321196 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:10.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 -- 172.21.15.27:0/3159321196 >> v2:172.21.15.124:3300/0 conn(0x7f6a0c144f10 msgr2=0x7f6a0c14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:10.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 --2- 172.21.15.27:0/3159321196 >> v2:172.21.15.124:3300/0 conn(0x7f6a0c144f10 0x7f6a0c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 -- 172.21.15.27:0/3159321196 >> v1:172.21.15.27:6789/0 conn(0x7f6a0c0b8b40 legacy=0x7f6a0c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.052+0000 7f6a09d9b640 1 -- 172.21.15.27:0/3159321196 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0bc9a0 con 0x7f6a0c144a80 2024-01-24T12:44:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a09d9b640 1 --2- 172.21.15.27:0/3159321196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144a80 0x7f6a0c14ac60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c067340 tx=0x7f6a0001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48308dfbb6efdb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a0959a640 1 -- 172.21.15.27:0/3159321196 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000a89f0 con 0x7f6a0c144a80 2024-01-24T12:44:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a0959a640 1 -- 172.21.15.27:0/3159321196 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000a8b50 con 0x7f6a0c144a80 2024-01-24T12:44:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a0959a640 1 -- 172.21.15.27:0/3159321196 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000b0440 con 0x7f6a0c144a80 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3159321196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144a80 msgr2=0x7f6a0c14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3159321196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144a80 0x7f6a0c14ac60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c067340 tx=0x7f6a0001ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3159321196 shutdown_connections 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3159321196 >> v2:172.21.15.124:3300/0 conn(0x7f6a0c144f10 0x7f6a0c14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3159321196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144a80 0x7f6a0c14ac60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3159321196 >> 172.21.15.27:0/3159321196 conn(0x7f6a0c0c02f0 msgr2=0x7f6a0c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:10.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3159321196 shutdown_connections 2024-01-24T12:44:10.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.056+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3159321196 wait complete. 2024-01-24T12:44:10.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 Processor -- start 2024-01-24T12:44:10.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- start start 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a0c0b8b40 0x7f6a0c1d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 0x7f6a0c1d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1d1810 con 0x7f6a0c144f10 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1e0e80 con 0x7f6a0c0b8b40 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1e02b0 con 0x7f6a0c144a80 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55650/0 (socket says 172.21.15.27:55650) 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 -- 172.21.15.27:0/3930304815 learned_addr learned my addr 172.21.15.27:0/3930304815 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a09d9b640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 0x7f6a0c1d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0a59c640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a0c0b8b40 0x7f6a0c1d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 -- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 msgr2=0x7f6a0c1d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 0x7f6a0c1d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 -- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a0c0b8b40 msgr2=0x7f6a0c1d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a0c0b8b40 0x7f6a0c1d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 -- 172.21.15.27:0/3930304815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000094d0 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a09d9b640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 0x7f6a0c1d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a0ad9d640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b9e0 tx=0x7f6a0400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400caa0 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400cc20 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c1d2a50 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04014440 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c1e0830 con 0x7f6a0c144f10 2024-01-24T12:44:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c1e1030 con 0x7f6a0c144f10 2024-01-24T12:44:10.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a0401d3b0 con 0x7f6a0c144f10 2024-01-24T12:44:10.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.060+0000 7f69faffd640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 0x7f69ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:10.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.064+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6a04083020 con 0x7f6a0c144f10 2024-01-24T12:44:10.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.064+0000 7f6a0a59c640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 0x7f69ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:10.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.064+0000 7f6a0a59c640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 0x7f69ec067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000f70 tx=0x7f69fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:10.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.068+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6a04050d30 con 0x7f6a0c144f10 2024-01-24T12:44:10.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.220+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a0c1e1030 con 0x7f6a0c144f10 2024-01-24T12:44:10.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:10.778 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:10.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.908+0000 7f69faffd640 1 -- 172.21.15.27:0/3930304815 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a0c1e1030 con 0x7f6a0c144f10 2024-01-24T12:44:10.913 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-01-24T12:44:10.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.924+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 msgr2=0x7f69ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.924+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 0x7f69ec067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69fc000f70 tx=0x7f69fc009040 comp rx=0 tx=0).stop 2024-01-24T12:44:10.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 msgr2=0x7f6a0c147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:10.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400b9e0 tx=0x7f6a0400bea0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 shutdown_connections 2024-01-24T12:44:10.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f69ec065a60 0x7f69ec067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6a0c144f10 0x7f6a0c147190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6a0c144a80 0x7f6a0c1d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 --2- 172.21.15.27:0/3930304815 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6a0c0b8b40 0x7f6a0c1d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:10.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.928+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 >> 172.21.15.27:0/3930304815 conn(0x7f6a0c0c02f0 msgr2=0x7f6a0c149a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:10.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.932+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 shutdown_connections 2024-01-24T12:44:10.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:10.932+0000 7f6a10ef6640 1 -- 172.21.15.27:0/3930304815 wait complete. 2024-01-24T12:44:10.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T12:44:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.076+0000 7f8db2116640 1 Processor -- start 2024-01-24T12:44:11.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.076+0000 7f8db2116640 1 -- start start 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8db2116640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8dac0b64c0 0x7f8dac1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8db2116640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0b82d0 con 0x7f8dac0b8c60 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8db2116640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac065c30 con 0x7f8dac06aaa0 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8db2116640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac06fc10 con 0x7f8dac0b64c0 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daaffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8dac0b8c60 0x7f8dac0b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56306/0 (socket says 172.21.15.27:56306) 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daaffd640 1 -- 172.21.15.27:0/4000261553 learned_addr learned my addr 172.21.15.27:0/4000261553 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8dabfff640 1 --2- 172.21.15.27:0/4000261553 >> v2:172.21.15.27:3300/0 conn(0x7f8dac0b64c0 0x7f8dac1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daa7fc640 1 -- 172.21.15.27:0/4000261553 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526267500 0 0) 0x7f8dac0b82d0 con 0x7f8dac0b8c60 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daa7fc640 1 -- 172.21.15.27:0/4000261553 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d94003530 con 0x7f8dac0b8c60 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8dabfff640 1 -- 172.21.15.27:0/4000261553 >> v1:172.21.15.124:6789/0 conn(0x7f8dac06aaa0 legacy=0x7f8dac1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8dabfff640 1 -- 172.21.15.27:0/4000261553 >> v1:172.21.15.27:6789/0 conn(0x7f8dac0b8c60 legacy=0x7f8dac0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8dabfff640 1 -- 172.21.15.27:0/4000261553 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac06f550 con 0x7f8dac0b64c0 2024-01-24T12:44:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8dabfff640 1 --2- 172.21.15.27:0/4000261553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac1540b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009dc0 tx=0x7f8da401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355aeeac746bfd64 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daa7fc640 1 -- 172.21.15.27:0/4000261553 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a58e0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daa7fc640 1 -- 172.21.15.27:0/4000261553 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40a5a40 con 0x7f8dac0b64c0 2024-01-24T12:44:11.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.080+0000 7f8daa7fc640 1 -- 172.21.15.27:0/4000261553 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a5dd0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/4000261553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 msgr2=0x7f8dac1540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 --2- 172.21.15.27:0/4000261553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac1540b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009dc0 tx=0x7f8da401c930 comp rx=0 tx=0).stop 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/4000261553 shutdown_connections 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 --2- 172.21.15.27:0/4000261553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac1540b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/4000261553 >> 172.21.15.27:0/4000261553 conn(0x7f8dac069d20 msgr2=0x7f8dac06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/4000261553 shutdown_connections 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/4000261553 wait complete. 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 Processor -- start 2024-01-24T12:44:11.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- start start 2024-01-24T12:44:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 0x7f8dac130ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 0x7f8dac13e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac12ede0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac13e470 con 0x7f8dac06aaa0 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0b2c00 con 0x7f8dac0b8c60 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58880/0 (socket says 172.21.15.27:58880) 2024-01-24T12:44:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 -- 172.21.15.27:0/708093513 learned_addr learned my addr 172.21.15.27:0/708093513 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8dabfff640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 0x7f8dac13e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8dab7fe640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 0x7f8dac130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 -- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 msgr2=0x7f8dac13e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 0x7f8dac13e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 -- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 msgr2=0x7f8dac130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 0x7f8dac130ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 -- 172.21.15.27:0/708093513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4009a70 con 0x7f8dac0b64c0 2024-01-24T12:44:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8dabfff640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 0x7f8dac13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8dab7fe640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 0x7f8dac130ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8daaffd640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00c420 tx=0x7f8d9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c005cf0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c005e50 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac131400 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0072d0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac12eb00 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.084+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac0663a0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.088+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8d9c007430 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.088+0000 7f8d93fff640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 0x7f8d98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.088+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8d9c082970 con 0x7f8dac0b64c0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.088+0000 7f8dab7fe640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 0x7f8d98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.088+0000 7f8dab7fe640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 0x7f8d98067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000f70 tx=0x7f8da0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.092+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8d9c054040 con 0x7f8dac0b64c0 2024-01-24T12:44:11.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.280+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8dac13e5b0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.296+0000 7f8d93fff640 1 -- 172.21.15.27:0/708093513 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8dac13e5b0 con 0x7f8dac0b64c0 2024-01-24T12:44:11.299 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 2 and data pool 3 2024-01-24T12:44:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.304+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 msgr2=0x7f8d98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.304+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 0x7f8d98067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000f70 tx=0x7f8da0009040 comp rx=0 tx=0).stop 2024-01-24T12:44:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.304+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 msgr2=0x7f8dac13d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.304+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00c420 tx=0x7f8d9c00c8e0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 shutdown_connections 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8d98065a60 0x7f8d98067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8dac0b8c60 0x7f8dac13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8dac0b64c0 0x7f8dac13d340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 --2- 172.21.15.27:0/708093513 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8dac06aaa0 0x7f8dac130ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 >> 172.21.15.27:0/708093513 conn(0x7f8dac069d20 msgr2=0x7f8dac141720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 shutdown_connections 2024-01-24T12:44:11.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.308+0000 7f8db2116640 1 -- 172.21.15.27:0/708093513 wait complete. 2024-01-24T12:44:11.335 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:11.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 Processor -- start 2024-01-24T12:44:11.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 -- start start 2024-01-24T12:44:11.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a80b8f90 0x7f28a814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 0x7f28a814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a81453a0 con 0x7f28a80b8f90 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a806c190 con 0x7f28a814b2e0 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28b0383640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a806cd10 con 0x7f28a8144fc0 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a80b8f90 0x7f28a814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f28a80b8f90 0x7f28a814ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58882/0 (socket says 172.21.15.27:58882) 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 -- 172.21.15.27:0/1860610292 learned_addr learned my addr 172.21.15.27:0/1860610292 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 -- 172.21.15.27:0/1860610292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 msgr2=0x7f28a8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ae11f640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ae920640 1 --2- 172.21.15.27:0/1860610292 >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 0x7f28a814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a8070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 -- 172.21.15.27:0/1860610292 >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 msgr2=0x7f28a814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 --2- 172.21.15.27:0/1860610292 >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 0x7f28a814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 -- 172.21.15.27:0/1860610292 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a814b770 con 0x7f28a80b8f90 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ae11f640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a8070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:11.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ae920640 1 --2- 172.21.15.27:0/1860610292 >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 0x7f28a814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:11.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.456+0000 7f28ad91e640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a80b8f90 0x7f28a814ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28a806cfd0 tx=0x7f289801c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185610601342365d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ad11d640 1 -- 172.21.15.27:0/1860610292 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980ab600 con 0x7f28a80b8f90 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ad11d640 1 -- 172.21.15.27:0/1860610292 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28980a7050 con 0x7f28a80b8f90 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ad11d640 1 -- 172.21.15.27:0/1860610292 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980ab980 con 0x7f28a80b8f90 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1860610292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a80b8f90 msgr2=0x7f28a814ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a80b8f90 0x7f28a814ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28a806cfd0 tx=0x7f289801c220 comp rx=0 tx=0).stop 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1860610292 shutdown_connections 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- 172.21.15.27:0/1860610292 >> v2:172.21.15.124:3300/0 conn(0x7f28a814b2e0 0x7f28a814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a80b8f90 0x7f28a814ada0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- 172.21.15.27:0/1860610292 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a8070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1860610292 >> 172.21.15.27:0/1860610292 conn(0x7f28a80be150 msgr2=0x7f28a80be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1860610292 shutdown_connections 2024-01-24T12:44:11.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1860610292 wait complete. 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 Processor -- start 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- start start 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a80b8f90 0x7f28a80b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a80b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80b7f10 con 0x7f28a814b2e0 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80b6410 con 0x7f28a80b8f90 2024-01-24T12:44:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a80b73a0 con 0x7f28a8144fc0 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58892/0 (socket says 172.21.15.27:58892) 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 -- 172.21.15.27:0/1367350649 learned_addr learned my addr 172.21.15.27:0/1367350649 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ad91e640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a80b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae11f640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a80b8f90 0x7f28a80b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 -- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 msgr2=0x7f28a80b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a80b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 -- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a80b8f90 msgr2=0x7f28a80b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a80b8f90 0x7f28a80b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 -- 172.21.15.27:0/1367350649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980094d0 con 0x7f28a814b2e0 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28ae920640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28a000cd50 tx=0x7f28a000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000f680 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a000f800 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a80b6660 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000fbb0 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.460+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a8142490 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a804e000 con 0x7f28a814b2e0 2024-01-24T12:44:11.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28a000b040 con 0x7f28a814b2e0 2024-01-24T12:44:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f289effd640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 0x7f288c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28a0083b70 con 0x7f28a814b2e0 2024-01-24T12:44:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f28ae11f640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 0x7f288c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.464+0000 7f28ae11f640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 0x7f288c067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006b20 tx=0x7f28a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.468+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f28a0051520 con 0x7f28a814b2e0 2024-01-24T12:44:11.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.628+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28a8071410 con 0x7f28a814b2e0 2024-01-24T12:44:11.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.628+0000 7f289effd640 1 -- 172.21.15.27:0/1367350649 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f28a001d090 con 0x7f28a814b2e0 2024-01-24T12:44:11.630 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:11.630 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:11.284481+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:11.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 msgr2=0x7f288c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 0x7f288c067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006b20 tx=0x7f28a4008040 comp rx=0 tx=0).stop 2024-01-24T12:44:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 msgr2=0x7f28a809d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28a000cd50 tx=0x7f28a000a650 comp rx=0 tx=0).stop 2024-01-24T12:44:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 shutdown_connections 2024-01-24T12:44:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f288c065a60 0x7f288c067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f28a814b2e0 0x7f28a809d5e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f28a8144fc0 0x7f28a80b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 --2- 172.21.15.27:0/1367350649 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f28a80b8f90 0x7f28a80b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 >> 172.21.15.27:0/1367350649 conn(0x7f28a80be150 msgr2=0x7f28a80b9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 shutdown_connections 2024-01-24T12:44:11.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.632+0000 7f28b0383640 1 -- 172.21.15.27:0/1367350649 wait complete. 2024-01-24T12:44:11.649 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:11.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 Processor -- start 2024-01-24T12:44:11.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 -- start start 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f49600bc340 0x7f4960142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4960071770 con 0x7f4960142d50 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49600b37e0 con 0x7f4960149470 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4968147640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49600b3ac0 con 0x7f49600bc340 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49656e2640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4960142d50 0x7f4960148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56310/0 (socket says 172.21.15.27:56310) 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49656e2640 1 -- 172.21.15.27:0/1104318301 learned_addr learned my addr 172.21.15.27:0/1104318301 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4965ee3640 1 --2- 172.21.15.27:0/1104318301 >> v2:172.21.15.124:3300/0 conn(0x7f49600bc340 0x7f4960142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964527169 0 0) 0x7f4960071770 con 0x7f4960142d50 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c003530 con 0x7f4960142d50 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645691803 0 0) 0x7f494c003530 con 0x7f4960142d50 2024-01-24T12:44:11.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 >> v2:172.21.15.124:3300/0 conn(0x7f49600bc340 msgr2=0x7f4960142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 --2- 172.21.15.27:0/1104318301 >> v2:172.21.15.124:3300/0 conn(0x7f49600bc340 0x7f4960142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 >> v1:172.21.15.124:6789/0 conn(0x7f4960149470 legacy=0x7f4960153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600b3da0 con 0x7f4960142d50 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f4950001680 con 0x7f4960142d50 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 >> v1:172.21.15.27:6789/0 conn(0x7f4960142d50 legacy=0x7f4960148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f494c003980 0x7f494c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c0047d0 0x7f494c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 0x7f494c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600b3ac0 con 0x7f494c005190 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c00c040 con 0x7f494c003980 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c00c200 con 0x7f494c0047d0 2024-01-24T12:44:11.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 0x7f494c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f4965ee3640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f494c003980 0x7f494c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49656e2640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c0047d0 0x7f494c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 -- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c0047d0 msgr2=0x7f494c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c0047d0 0x7f494c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 -- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f494c003980 msgr2=0x7f494c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f494c003980 0x7f494c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.776+0000 7f49666e4640 1 -- 172.21.15.27:0/1104318301 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c003530 con 0x7f494c005190 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49666e4640 1 -- 172.21.15.27:0/1104318301 reap_dead start 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49666e4640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 0x7f494c00b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f495c001780 tx=0x7f495c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed51a97463555ebe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0052d0 con 0x7f494c005190 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c0a7050 con 0x7f494c005190 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4964ee1640 1 -- 172.21.15.27:0/1104318301 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c003600 con 0x7f494c005190 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 msgr2=0x7f494c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 0x7f494c00b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f495c001780 tx=0x7f495c01c400 comp rx=0 tx=0).stop 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- 172.21.15.27:0/1104318301 shutdown_connections 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 --2- 172.21.15.27:0/1104318301 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f494c005190 0x7f494c00b990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- 172.21.15.27:0/1104318301 >> 172.21.15.27:0/1104318301 conn(0x7f4960069ef0 msgr2=0x7f496006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- 172.21.15.27:0/1104318301 shutdown_connections 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- 172.21.15.27:0/1104318301 wait complete. 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 Processor -- start 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- start start 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c005190 0x7f49601433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49601de220 0x7f49601de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49601438e0 con 0x7f496013b350 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496013e370 con 0x7f49601de220 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4968147640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496013e5c0 con 0x7f494c005190 2024-01-24T12:44:11.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58910/0 (socket says 172.21.15.27:58910) 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 -- 172.21.15.27:0/2632335699 learned_addr learned my addr 172.21.15.27:0/2632335699 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f4965ee3640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c005190 0x7f49601433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49666e4640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49601de220 0x7f49601de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 -- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c005190 msgr2=0x7f49601433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c005190 0x7f49601433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 -- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49601de220 msgr2=0x7f49601de6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49601de220 0x7f49601de6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 -- 172.21.15.27:0/2632335699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496013bcf0 con 0x7f496013b350 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.780+0000 7f49656e2640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f495000d7a0 tx=0x7f495000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49500074e0 con 0x7f496013b350 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4950007640 con 0x7f496013b350 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49601debe0 con 0x7f496013b350 2024-01-24T12:44:11.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49500049f0 con 0x7f496013b350 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496013d0c0 con 0x7f496013b350 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4960067050 con 0x7f496013b350 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4950004b50 con 0x7f496013b350 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 0x7f4944067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4950082a60 con 0x7f496013b350 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f4965ee3640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 0x7f4944067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:11.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.784+0000 7f4965ee3640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 0x7f4944067f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4958007380 tx=0x7f495800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:11.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.788+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4950050420 con 0x7f496013b350 2024-01-24T12:44:11.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.944+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f496004e000 con 0x7f496013b350 2024-01-24T12:44:11.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f49567fc640 1 -- 172.21.15.27:0/2632335699 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f4950053a40 con 0x7f496013b350 2024-01-24T12:44:11.948 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:11.948 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":19,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:11.284481+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 msgr2=0x7f4944067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 0x7f4944067f50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4958007380 tx=0x7f495800b040 comp rx=0 tx=0).stop 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 msgr2=0x7f496013b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f495000d7a0 tx=0x7f495000dc60 comp rx=0 tx=0).stop 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 shutdown_connections 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4944065a90 0x7f4944067f50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49601de220 0x7f49601de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f496013b350 0x7f496013b7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 --2- 172.21.15.27:0/2632335699 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f494c005190 0x7f49601433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 >> 172.21.15.27:0/2632335699 conn(0x7f4960069ef0 msgr2=0x7f496006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 shutdown_connections 2024-01-24T12:44:11.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:11.948+0000 7f4968147640 1 -- 172.21.15.27:0/2632335699 wait complete. 2024-01-24T12:44:11.966 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T12:44:12.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 Processor -- start 2024-01-24T12:44:12.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 -- start start 2024-01-24T12:44:12.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b7c06fc30 0x7f0b7c0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0b7c144100 0x7f0b7c144590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c070ef0 con 0x7f0b7c1474b0 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c071640 con 0x7f0b7c06fc30 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.084+0000 7f0b81f98640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c06ecc0 con 0x7f0b7c144100 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b7c06fc30 0x7f0b7c0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7affd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0b7c1474b0 0x7f0b7c1478f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56326/0 (socket says 172.21.15.27:56326) 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7affd640 1 -- 172.21.15.27:0/3731627024 learned_addr learned my addr 172.21.15.27:0/3731627024 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7bfff640 1 --2- 172.21.15.27:0/3731627024 >> v2:172.21.15.124:3300/0 conn(0x7f0b7c144100 0x7f0b7c144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 -- 172.21.15.27:0/3731627024 >> v2:172.21.15.124:3300/0 conn(0x7f0b7c144100 msgr2=0x7f0b7c144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 --2- 172.21.15.27:0/3731627024 >> v2:172.21.15.124:3300/0 conn(0x7f0b7c144100 0x7f0b7c144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 -- 172.21.15.27:0/3731627024 >> v1:172.21.15.27:6789/0 conn(0x7f0b7c1474b0 legacy=0x7f0b7c1478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 -- 172.21.15.27:0/3731627024 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c06ef30 con 0x7f0b7c06fc30 2024-01-24T12:44:12.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7a7fc640 1 -- 172.21.15.27:0/3731627024 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880234972 0 0) 0x7f0b70001120 con 0x7f0b7c1474b0 2024-01-24T12:44:12.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7b7fe640 1 --2- 172.21.15.27:0/3731627024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c0709b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c148000 tx=0x7f0b7401da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be3024179c7f2c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:12.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7a7fc640 1 -- 172.21.15.27:0/3731627024 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400a2d0 con 0x7f0b7c06fc30 2024-01-24T12:44:12.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7a7fc640 1 -- 172.21.15.27:0/3731627024 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740a6840 con 0x7f0b7c06fc30 2024-01-24T12:44:12.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b7a7fc640 1 -- 172.21.15.27:0/3731627024 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740a6bd0 con 0x7f0b7c06fc30 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 -- 172.21.15.27:0/3731627024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c06fc30 msgr2=0x7f0b7c0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 --2- 172.21.15.27:0/3731627024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c0709b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c148000 tx=0x7f0b7401da00 comp rx=0 tx=0).stop 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 -- 172.21.15.27:0/3731627024 shutdown_connections 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 --2- 172.21.15.27:0/3731627024 >> v2:172.21.15.124:3300/0 conn(0x7f0b7c144100 0x7f0b7c144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 --2- 172.21.15.27:0/3731627024 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c0709b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 -- 172.21.15.27:0/3731627024 >> 172.21.15.27:0/3731627024 conn(0x7f0b7c06a120 msgr2=0x7f0b7c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 -- 172.21.15.27:0/3731627024 shutdown_connections 2024-01-24T12:44:12.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.088+0000 7f0b81f98640 1 -- 172.21.15.27:0/3731627024 wait complete. 2024-01-24T12:44:12.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 Processor -- start 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- start start 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c1e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0b7c1474b0 0x7f0b7c13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0bad50 con 0x7f0b7c144100 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c140b70 con 0x7f0b7c06fc30 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b5410 con 0x7f0b7c1474b0 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58936/0 (socket says 172.21.15.27:58936) 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 -- 172.21.15.27:0/1008360507 learned_addr learned my addr 172.21.15.27:0/1008360507 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 -- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0b7c1474b0 msgr2=0x7f0b7c13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0b7c1474b0 0x7f0b7c13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 -- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0b7c06fc30 msgr2=0x7f0b7c1e5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c1e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 -- 172.21.15.27:0/1008360507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7400ab80 con 0x7f0b7c144100 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b7affd640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c780 tx=0x7f0b7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b700072d0 con 0x7f0b7c144100 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70007450 con 0x7f0b7c144100 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0b56f0 con 0x7f0b7c144100 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b700047f0 con 0x7f0b7c144100 2024-01-24T12:44:12.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0b38e0 con 0x7f0b7c144100 2024-01-24T12:44:12.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c04e000 con 0x7f0b7c144100 2024-01-24T12:44:12.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b70004950 con 0x7f0b7c144100 2024-01-24T12:44:12.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 0x7f0b68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:12.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.092+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b70082370 con 0x7f0b7c144100 2024-01-24T12:44:12.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.096+0000 7f0b7b7fe640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 0x7f0b68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:12.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.096+0000 7f0b7b7fe640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 0x7f0b68067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b740af000 tx=0x7f0b74004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:12.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.100+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0b7004fca0 con 0x7f0b7c144100 2024-01-24T12:44:12.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.288+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b7c070ef0 con 0x7f0b7c144100 2024-01-24T12:44:12.356 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T12:44:12.356+0000 7f18fae87640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T12:44:12.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.948+0000 7f0b63fff640 1 -- 172.21.15.27:0/1008360507 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b7c070ef0 con 0x7f0b7c144100 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 msgr2=0x7f0b68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 0x7f0b68067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b740af000 tx=0x7f0b74004ac0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 msgr2=0x7f0b7c0ba810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c780 tx=0x7f0b7000cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 shutdown_connections 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0b68065a60 0x7f0b68067f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0b7c1474b0 0x7f0b7c13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b7c144100 0x7f0b7c0ba810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 --2- 172.21.15.27:0/1008360507 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0b7c06fc30 0x7f0b7c1e5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 >> 172.21.15.27:0/1008360507 conn(0x7f0b7c06a120 msgr2=0x7f0b7c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:12.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 shutdown_connections 2024-01-24T12:44:12.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:12.952+0000 7f0b81f98640 1 -- 172.21.15.27:0/1008360507 wait complete. 2024-01-24T12:44:12.974 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-24T12:44:12.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-24T12:44:13.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 Processor -- start 2024-01-24T12:44:13.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 -- start start 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 0x7f73dc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0b82e0 con 0x7f73dc069f80 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0700d0 con 0x7f73dc14dea0 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e2930640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc070380 con 0x7f73dc06fc40 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73d3fff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 0x7f73dc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:55568/0 (socket says 172.21.15.27:55568) 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 -- 172.21.15.27:0/1864767493 learned_addr learned my addr 172.21.15.27:0/1864767493 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:13.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 -- 172.21.15.27:0/1864767493 >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 msgr2=0x7f73dc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 --2- 172.21.15.27:0/1864767493 >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 0x7f73dc0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 -- 172.21.15.27:0/1864767493 >> v1:172.21.15.124:6789/0 conn(0x7f73dc069f80 legacy=0x7f73dc0b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73e0ecd640 1 -- 172.21.15.27:0/1864767493 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc070660 con 0x7f73dc06fc40 2024-01-24T12:44:13.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.108+0000 7f73d3fff640 1 --2- 172.21.15.27:0/1864767493 >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 0x7f73dc0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:13.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e0ecd640 1 --2- 172.21.15.27:0/1864767493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009e50 tx=0x7f73d401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e445ea6dc49503 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:13.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73db7fe640 1 -- 172.21.15.27:0/1864767493 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40af400 con 0x7f73dc06fc40 2024-01-24T12:44:13.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73db7fe640 1 -- 172.21.15.27:0/1864767493 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d40ab050 con 0x7f73dc06fc40 2024-01-24T12:44:13.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73db7fe640 1 -- 172.21.15.27:0/1864767493 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40af780 con 0x7f73dc06fc40 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- 172.21.15.27:0/1864767493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 msgr2=0x7f73dc1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 --2- 172.21.15.27:0/1864767493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009e50 tx=0x7f73d401f1f0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- 172.21.15.27:0/1864767493 shutdown_connections 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 --2- 172.21.15.27:0/1864767493 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc1447d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 --2- 172.21.15.27:0/1864767493 >> v2:172.21.15.124:3300/0 conn(0x7f73dc14dea0 0x7f73dc0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- 172.21.15.27:0/1864767493 >> 172.21.15.27:0/1864767493 conn(0x7f73dc0bcf70 msgr2=0x7f73dc0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- 172.21.15.27:0/1864767493 shutdown_connections 2024-01-24T12:44:13.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- 172.21.15.27:0/1864767493 wait complete. 2024-01-24T12:44:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 Processor -- start 2024-01-24T12:44:13.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.112+0000 7f73e2930640 1 -- start start 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 0x7f73dc141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc0bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc142e30 con 0x7f73dc14dea0 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc146010 con 0x7f73dc069f80 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0bc2a0 con 0x7f73dc06fc40 2024-01-24T12:44:13.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58938/0 (socket says 172.21.15.27:58938) 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 -- 172.21.15.27:0/167186144 learned_addr learned my addr 172.21.15.27:0/167186144 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d3fff640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc0bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73dbfff640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 0x7f73dc141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 -- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 msgr2=0x7f73dc0bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc0bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 -- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 msgr2=0x7f73dc141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 0x7f73dc141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 -- 172.21.15.27:0/167186144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4009420 con 0x7f73dc14dea0 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73dbfff640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 0x7f73dc141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:13.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e0ecd640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d401ce20 tx=0x7f73d401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40c0070 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4009510 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d4009b30 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40afcf0 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc142590 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc1e3280 con 0x7f73dc14dea0 2024-01-24T12:44:13.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73d40b6040 con 0x7f73dc14dea0 2024-01-24T12:44:13.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 0x7f73bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:13.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73d4120a40 con 0x7f73dc14dea0 2024-01-24T12:44:13.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.116+0000 7f73dbfff640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 0x7f73bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:13.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.120+0000 7f73dbfff640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 0x7f73bc067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000f70 tx=0x7f73cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:13.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.120+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f73dc1e3280 con 0x7f73dc14dea0 2024-01-24T12:44:13.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.311+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f73dc1e3280 con 0x7f73dc14dea0 2024-01-24T12:44:13.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.951+0000 7f73d97fa640 1 -- 172.21.15.27:0/167186144 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73dc1e3280 con 0x7f73dc14dea0 2024-01-24T12:44:13.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 msgr2=0x7f73bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 0x7f73bc067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000f70 tx=0x7f73cc009040 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 msgr2=0x7f73dc1e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d401ce20 tx=0x7f73d401bf90 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 shutdown_connections 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73bc065a60 0x7f73bc067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73dc14dea0 0x7f73dc1e3560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73dc06fc40 0x7f73dc0bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 --2- 172.21.15.27:0/167186144 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73dc069f80 0x7f73dc141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 >> 172.21.15.27:0/167186144 conn(0x7f73dc0bcf70 msgr2=0x7f73dc13eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:13.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 shutdown_connections 2024-01-24T12:44:13.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:13.955+0000 7f73e2930640 1 -- 172.21.15.27:0/167186144 wait complete. 2024-01-24T12:44:13.977 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-24T12:44:13.977 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.099+0000 7f662300a640 1 Processor -- start 2024-01-24T12:44:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 -- start start 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f661c0bc340 0x7f661c142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c149470 0x7f661c153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c071770 con 0x7f661c142d50 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c0b37e0 con 0x7f661c0bc340 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f662300a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0b3ac0 con 0x7f661c149470 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f661c0bc340 0x7f661c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661bfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f661c142d50 0x7f661c148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56332/0 (socket says 172.21.15.27:56332) 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661bfff640 1 -- 172.21.15.27:0/768187582 learned_addr learned my addr 172.21.15.27:0/768187582 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f66215a7640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c149470 0x7f661c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 -- 172.21.15.27:0/768187582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c149470 msgr2=0x7f661c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:14.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c149470 0x7f661c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 -- 172.21.15.27:0/768187582 >> v1:172.21.15.27:6789/0 conn(0x7f661c142d50 legacy=0x7f661c148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 -- 172.21.15.27:0/768187582 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c0b3da0 con 0x7f661c0bc340 2024-01-24T12:44:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661b7fe640 1 -- 172.21.15.27:0/768187582 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096691186 0 0) 0x7f661c071770 con 0x7f661c142d50 2024-01-24T12:44:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f6620da6640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0bc340 0x7f661c142810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d93330bffac9784 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661b7fe640 1 -- 172.21.15.27:0/768187582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100a8970 con 0x7f661c0bc340 2024-01-24T12:44:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661b7fe640 1 -- 172.21.15.27:0/768187582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100a8ad0 con 0x7f661c0bc340 2024-01-24T12:44:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.103+0000 7f661b7fe640 1 -- 172.21.15.27:0/768187582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100a8e60 con 0x7f661c0bc340 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/768187582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0bc340 msgr2=0x7f661c142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0bc340 0x7f661c142810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001ec70 comp rx=0 tx=0).stop 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/768187582 shutdown_connections 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c149470 0x7f661c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- 172.21.15.27:0/768187582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0bc340 0x7f661c142810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/768187582 >> 172.21.15.27:0/768187582 conn(0x7f661c069ef0 msgr2=0x7f661c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/768187582 shutdown_connections 2024-01-24T12:44:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/768187582 wait complete. 2024-01-24T12:44:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 Processor -- start 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- start start 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661c149470 0x7f661c13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c1e3850 0x7f661c1d3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c13b890 con 0x7f661c0b5650 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1d3a60 con 0x7f661c149470 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c070630 con 0x7f661c1e3850 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58952/0 (socket says 172.21.15.27:58952) 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 -- 172.21.15.27:0/1678519164 learned_addr learned my addr 172.21.15.27:0/1678519164 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f661bfff640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c1e3850 0x7f661c1d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 -- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c1e3850 msgr2=0x7f661c1d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c1e3850 0x7f661c1d3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f6620da6640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661c149470 0x7f661c13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 -- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661c149470 msgr2=0x7f661c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661c149470 0x7f661c13bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 -- 172.21.15.27:0/1678519164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610009420 con 0x7f661c0b5650 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66215a7640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6614007e90 tx=0x7f661400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614014420 con 0x7f661c0b5650 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6614014580 con 0x7f661c0b5650 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614014930 con 0x7f661c0b5650 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c13bb00 con 0x7f661c0b5650 2024-01-24T12:44:14.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.107+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c06f270 con 0x7f661c0b5650 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c13bc90 con 0x7f661c0b5650 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6614014a90 con 0x7f661c0b5650 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f66197fa640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 0x7f6608067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6614083b80 con 0x7f661c0b5650 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f6620da6640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 0x7f6608067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.111+0000 7f6620da6640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 0x7f6608067f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66100b2000 tx=0x7f66100aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.115+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6614051410 con 0x7f661c0b5650 2024-01-24T12:44:14.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.303+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f661c04e000 con 0x7f661c0b5650 2024-01-24T12:44:14.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.303+0000 7f66197fa640 1 -- 172.21.15.27:0/1678519164 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f6614083e60 con 0x7f661c0b5650 2024-01-24T12:44:14.306 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:14.306 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 msgr2=0x7f6608067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 0x7f6608067f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66100b2000 tx=0x7f66100aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 msgr2=0x7f661c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6614007e90 tx=0x7f661400e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 shutdown_connections 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6608065a90 0x7f6608067f50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f661c0b5650 0x7f661c0b5ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f661c1e3850 0x7f661c1d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 --2- 172.21.15.27:0/1678519164 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f661c149470 0x7f661c13bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 >> 172.21.15.27:0/1678519164 conn(0x7f661c069ef0 msgr2=0x7f661c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 shutdown_connections 2024-01-24T12:44:14.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.307+0000 7f662300a640 1 -- 172.21.15.27:0/1678519164 wait complete. 2024-01-24T12:44:14.326 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:14.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.447+0000 7f6f8d4ba640 1 Processor -- start 2024-01-24T12:44:14.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.447+0000 7f6f8d4ba640 1 -- start start 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6f880bc340 0x7f6f8806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8814e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880707e0 con 0x7f6f8806f4f0 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880703c0 con 0x7f6f880bc340 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b8750 con 0x7f6f8814ded0 2024-01-24T12:44:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f867fc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6f8806f4f0 0x7f6f88144830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56334/0 (socket says 172.21.15.27:56334) 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f867fc640 1 -- 172.21.15.27:0/2377350095 learned_addr learned my addr 172.21.15.27:0/2377350095 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6f880bc340 0x7f6f8806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f877fe640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 -- 172.21.15.27:0/2377350095 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 msgr2=0x7f6f8814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 -- 172.21.15.27:0/2377350095 >> v1:172.21.15.27:6789/0 conn(0x7f6f8806f4f0 legacy=0x7f6f88144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f85ffb640 1 -- 172.21.15.27:0/2377350095 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259353448 0 0) 0x7f6f880707e0 con 0x7f6f8806f4f0 2024-01-24T12:44:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 -- 172.21.15.27:0/2377350095 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8806fa10 con 0x7f6f880bc340 2024-01-24T12:44:14.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f86ffd640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8806eeb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f780097c0 tx=0x7f6f7801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3ebfb1c66b90b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f85ffb640 1 -- 172.21.15.27:0/2377350095 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780a7070 con 0x7f6f880bc340 2024-01-24T12:44:14.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f85ffb640 1 -- 172.21.15.27:0/2377350095 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f780ab430 con 0x7f6f880bc340 2024-01-24T12:44:14.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f85ffb640 1 -- 172.21.15.27:0/2377350095 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ab7c0 con 0x7f6f880bc340 2024-01-24T12:44:14.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/2377350095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 msgr2=0x7f6f8806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8806eeb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f780097c0 tx=0x7f6f7801c450 comp rx=0 tx=0).stop 2024-01-24T12:44:14.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/2377350095 shutdown_connections 2024-01-24T12:44:14.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/2377350095 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8806eeb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/2377350095 >> 172.21.15.27:0/2377350095 conn(0x7f6f88069ef0 msgr2=0x7f6f8806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/2377350095 shutdown_connections 2024-01-24T12:44:14.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.451+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/2377350095 wait complete. 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 Processor -- start 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- start start 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f8806f4f0 0x7f6f881e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8813c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8813b700 con 0x7f6f880bc340 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f881e6780 con 0x7f6f8806f4f0 2024-01-24T12:44:14.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f881e6a60 con 0x7f6f8814ded0 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58978/0 (socket says 172.21.15.27:58978) 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 -- 172.21.15.27:0/362469510 learned_addr learned my addr 172.21.15.27:0/362469510 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f877fe640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8813c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 -- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 msgr2=0x7f6f8813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8813c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 -- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f8806f4f0 msgr2=0x7f6f881e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f8806f4f0 0x7f6f881e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 -- 172.21.15.27:0/362469510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009420 con 0x7f6f880bc340 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f867fc640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f70001570 tx=0x7f6f7000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000a640 con 0x7f6f880bc340 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7000a7c0 con 0x7f6f880bc340 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f881e6490 con 0x7f6f880bc340 2024-01-24T12:44:14.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000ab70 con 0x7f6f880bc340 2024-01-24T12:44:14.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f88147fb0 con 0x7f6f880bc340 2024-01-24T12:44:14.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8813bcc0 con 0x7f6f880bc340 2024-01-24T12:44:14.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.455+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f7000acd0 con 0x7f6f880bc340 2024-01-24T12:44:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.459+0000 7f6f7f7fe640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 0x7f6f68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.459+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f70082b80 con 0x7f6f880bc340 2024-01-24T12:44:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.459+0000 7f6f86ffd640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 0x7f6f68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.459+0000 7f6f86ffd640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 0x7f6f68067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f780af000 tx=0x7f6f78004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.463+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6f700504b0 con 0x7f6f880bc340 2024-01-24T12:44:14.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.627+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f881e6c20 con 0x7f6f880bc340 2024-01-24T12:44:14.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.627+0000 7f6f7f7fe640 1 -- 172.21.15.27:0/362469510 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f6f70018070 con 0x7f6f880bc340 2024-01-24T12:44:14.630 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:14.630 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 msgr2=0x7f6f68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 0x7f6f68067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f780af000 tx=0x7f6f78004740 comp rx=0 tx=0).stop 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 msgr2=0x7f6f8813be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f70001570 tx=0x7f6f7000cd20 comp rx=0 tx=0).stop 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 shutdown_connections 2024-01-24T12:44:14.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f68065a60 0x7f6f68067f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f8814ded0 0x7f6f8813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f880bc340 0x7f6f8813be70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 --2- 172.21.15.27:0/362469510 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f8806f4f0 0x7f6f881e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 >> 172.21.15.27:0/362469510 conn(0x7f6f88069ef0 msgr2=0x7f6f880b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 shutdown_connections 2024-01-24T12:44:14.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.631+0000 7f6f8d4ba640 1 -- 172.21.15.27:0/362469510 wait complete. 2024-01-24T12:44:14.650 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-24T12:44:14.650 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:14.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.763+0000 7f611d4c2640 1 Processor -- start 2024-01-24T12:44:14.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.763+0000 7f611d4c2640 1 -- start start 2024-01-24T12:44:14.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f611d4c2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6118070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f611d4c2640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61180b2c80 con 0x7f6118071a20 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f611d4c2640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611806fdb0 con 0x7f6118147920 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f611d4c2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6118070370 con 0x7f61180708d0 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6118071a20 0x7f6118147210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56348/0 (socket says 172.21.15.27:56348) 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 -- 172.21.15.27:0/666401850 learned_addr learned my addr 172.21.15.27:0/666401850 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6116ffd640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6118070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777383717 0 0) 0x7f61180b2c80 con 0x7f6118071a20 2024-01-24T12:44:14.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6100004640 con 0x7f6118071a20 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 343864833 0 0) 0x7f6100004640 con 0x7f6118071a20 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 msgr2=0x7f6118070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6118070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 >> v1:172.21.15.124:6789/0 conn(0x7f6118147920 legacy=0x7f61181440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180b2ed0 con 0x7f6118071a20 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f610c001680 con 0x7f6118071a20 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 >> v1:172.21.15.27:6789/0 conn(0x7f6118071a20 legacy=0x7f6118147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6100004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6100005000 0x7f61000058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005e20 0x7f61000062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6118070370 con 0x7f6100005000 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610000cb00 con 0x7f6100005e20 2024-01-24T12:44:14.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000034d0 con 0x7f61180708d0 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6100005000 0x7f61000058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f6116ffd640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6100004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61177fe640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005e20 0x7f61000062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 -- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 msgr2=0x7f6100004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180708d0 0x7f6100004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 -- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005e20 msgr2=0x7f61000062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005e20 0x7f61000062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.767+0000 7f61167fc640 1 -- 172.21.15.27:0/666401850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100004640 con 0x7f6100005000 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61167fc640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6100005000 0x7f61000058e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f610c00c210 tx=0x7f610c01cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d8f9f8aea3146d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c005ae0 con 0x7f6100005000 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c005c60 con 0x7f6100005000 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f6115ffb640 1 -- 172.21.15.27:0/666401850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c0a5a90 con 0x7f6100005000 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- 172.21.15.27:0/666401850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6100005000 msgr2=0x7f61000058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 --2- 172.21.15.27:0/666401850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6100005000 0x7f61000058e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f610c00c210 tx=0x7f610c01cb50 comp rx=0 tx=0).stop 2024-01-24T12:44:14.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 -- 172.21.15.27:0/666401850 reap_dead start 2024-01-24T12:44:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- 172.21.15.27:0/666401850 shutdown_connections 2024-01-24T12:44:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- 172.21.15.27:0/666401850 >> 172.21.15.27:0/666401850 conn(0x7f6118069ef0 msgr2=0x7f611806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- 172.21.15.27:0/666401850 shutdown_connections 2024-01-24T12:44:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- 172.21.15.27:0/666401850 wait complete. 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 Processor -- start 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- start start 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005000 0x7f61180b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 0x7f61181e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611814e790 con 0x7f61181e3980 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611814a9c0 con 0x7f6100005000 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f611d4c2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180b52e0 con 0x7f61180b1de0 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59004/0 (socket says 172.21.15.27:59004) 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 -- 172.21.15.27:0/2152082900 learned_addr learned my addr 172.21.15.27:0/2152082900 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f6116ffd640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005000 0x7f61180b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61167fc640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 0x7f61181e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 -- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 msgr2=0x7f61181e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 0x7f61181e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 -- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005000 msgr2=0x7f61180b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005000 0x7f61180b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61177fe640 1 -- 172.21.15.27:0/2152082900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611814ac80 con 0x7f61181e3980 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.771+0000 7f61167fc640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 0x7f61181e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f61177fe640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f611814b5d0 tx=0x7f611000eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003980 con 0x7f61181e3980 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110003ae0 con 0x7f61181e3980 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611814af60 con 0x7f61181e3980 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003e90 con 0x7f61181e3980 2024-01-24T12:44:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61180b5f10 con 0x7f61181e3980 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611804e000 con 0x7f61181e3980 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61100050d0 con 0x7f61181e3980 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 0x7f6104067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61100830d0 con 0x7f61181e3980 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f6116ffd640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 0x7f6104067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:14.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.775+0000 7f6116ffd640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 0x7f6104067f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6108009a30 tx=0x7f6108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:14.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.779+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6110050a90 con 0x7f61181e3980 2024-01-24T12:44:14.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.931+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61180710c0 con 0x7f6104065a90 2024-01-24T12:44:14.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.951+0000 7f60ff7fe640 1 -- 172.21.15.27:0/2152082900 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249785 (secure 0 0 0) 0x7f6108013a20 con 0x7f6104065a90 2024-01-24T12:44:14.955 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:14.957 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:14.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 msgr2=0x7f6104067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 0x7f6104067f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6108009a30 tx=0x7f6108008040 comp rx=0 tx=0).stop 2024-01-24T12:44:14.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 msgr2=0x7f61181493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:14.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f611814b5d0 tx=0x7f611000eb70 comp rx=0 tx=0).stop 2024-01-24T12:44:14.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 shutdown_connections 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6104065a90 0x7f6104067f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f61181e3980 0x7f61181493d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f61180b1de0 0x7f61181e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 --2- 172.21.15.27:0/2152082900 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6100005000 0x7f61180b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 >> 172.21.15.27:0/2152082900 conn(0x7f6118069ef0 msgr2=0x7f61181433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 shutdown_connections 2024-01-24T12:44:14.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:14.955+0000 7f611d4c2640 1 -- 172.21.15.27:0/2152082900 wait complete. 2024-01-24T12:44:14.974 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-24T12:44:13.621007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218800,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-24T12:44:02.784393+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:02.784393+0000","last_peered":"2024-01-24T12:44:02.784393+0000","last_clean":"2024-01-24T12:44:02.784393+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:02.784393+0000","last_undegraded":"2024-01-24T12:44:02.784393+0000","last_fullsized":"2024-01-24T12:44:02.784393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:14.978 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:15.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.135+0000 7f510314a640 1 Processor -- start 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.135+0000 7f510314a640 1 -- start start 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f510314a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50fc071160 0x7f50fc0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f510314a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc0b42d0 0x7f50fc0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f510314a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc0b3c40 con 0x7f50fc1429f0 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f510314a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc0b5140 con 0x7f50fc071160 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f510314a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0b4740 con 0x7f50fc0b42d0 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50fc071160 0x7f50fc0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f50fc071160 0x7f50fc0b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59014/0 (socket says 172.21.15.27:59014) 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 -- 172.21.15.27:0/3918773123 learned_addr learned my addr 172.21.15.27:0/3918773123 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f50fbfff640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc0b42d0 0x7f50fc0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 -- 172.21.15.27:0/3918773123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc0b42d0 msgr2=0x7f50fc0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc0b42d0 0x7f50fc0b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 -- 172.21.15.27:0/3918773123 >> v1:172.21.15.124:6789/0 conn(0x7f50fc1429f0 legacy=0x7f50fc14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:15.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.139+0000 7f5100ee6640 1 -- 172.21.15.27:0/3918773123 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0b9f60 con 0x7f50fc071160 2024-01-24T12:44:15.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f5100ee6640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc071160 0x7f50fc0b9900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59168f624be63bf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f50fb7fe640 1 -- 172.21.15.27:0/3918773123 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ac600 con 0x7f50fc071160 2024-01-24T12:44:15.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f50fb7fe640 1 -- 172.21.15.27:0/3918773123 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00a8050 con 0x7f50fc071160 2024-01-24T12:44:15.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f50fb7fe640 1 -- 172.21.15.27:0/3918773123 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ac980 con 0x7f50fc071160 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- 172.21.15.27:0/3918773123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc071160 msgr2=0x7f50fc0b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc071160 0x7f50fc0b9900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c4d0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- 172.21.15.27:0/3918773123 shutdown_connections 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc0b42d0 0x7f50fc0b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- 172.21.15.27:0/3918773123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc071160 0x7f50fc0b9900 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- 172.21.15.27:0/3918773123 >> 172.21.15.27:0/3918773123 conn(0x7f50fc0be150 msgr2=0x7f50fc0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- 172.21.15.27:0/3918773123 shutdown_connections 2024-01-24T12:44:15.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- 172.21.15.27:0/3918773123 wait complete. 2024-01-24T12:44:15.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 Processor -- start 2024-01-24T12:44:15.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- start start 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 0x7f50fc1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50fc0b42d0 0x7f50fc14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc144ca0 con 0x7f50fc1429f0 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc14b3b0 con 0x7f50fc0b42d0 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f510314a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc145d10 con 0x7f50fc071160 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59026/0 (socket says 172.21.15.27:59026) 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 -- 172.21.15.27:0/314365219 learned_addr learned my addr 172.21.15.27:0/314365219 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f5100ee6640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 0x7f50fc1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f50fbfff640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50fc0b42d0 0x7f50fc14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 -- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 msgr2=0x7f50fc1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 0x7f50fc1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 -- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50fc0b42d0 msgr2=0x7f50fc14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50fc0b42d0 0x7f50fc14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f51016e7640 1 -- 172.21.15.27:0/314365219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00094d0 con 0x7f50fc1429f0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.143+0000 7f5100ee6640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 0x7f50fc1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f51016e7640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50f400c780 tx=0x7f50f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f4004b70 con 0x7f50fc1429f0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400ce90 con 0x7f50fc1429f0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc143540 con 0x7f50fc1429f0 2024-01-24T12:44:15.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400a850 con 0x7f50fc1429f0 2024-01-24T12:44:15.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc145fb0 con 0x7f50fc1429f0 2024-01-24T12:44:15.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc0b93c0 con 0x7f50fc1429f0 2024-01-24T12:44:15.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50f400a9b0 con 0x7f50fc1429f0 2024-01-24T12:44:15.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 0x7f50e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50f4083300 con 0x7f50fc1429f0 2024-01-24T12:44:15.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f5100ee6640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 0x7f50e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.147+0000 7f5100ee6640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 0x7f50e8067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ae000 tx=0x7f50f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.151+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f50fc0b93c0 con 0x7f50fc1429f0 2024-01-24T12:44:15.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.299+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50fc0ba800 con 0x7f50e8065a60 2024-01-24T12:44:15.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.319+0000 7f50f97fa640 1 -- 172.21.15.27:0/314365219 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249785 (secure 0 0 0) 0x7f50f00bb090 con 0x7f50e8065a60 2024-01-24T12:44:15.322 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:15.323 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:15.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 msgr2=0x7f50e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 0x7f50e8067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ae000 tx=0x7f50f0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 msgr2=0x7f50fc06c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50f400c780 tx=0x7f50f400cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 shutdown_connections 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50e8065a60 0x7f50e8067f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50fc1429f0 0x7f50fc06c0e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50fc0b42d0 0x7f50fc14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 --2- 172.21.15.27:0/314365219 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50fc071160 0x7f50fc1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 >> 172.21.15.27:0/314365219 conn(0x7f50fc0be150 msgr2=0x7f50fc153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 shutdown_connections 2024-01-24T12:44:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.323+0000 7f510314a640 1 -- 172.21.15.27:0/314365219 wait complete. 2024-01-24T12:44:15.338 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-24T12:44:13.621007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218800,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-24T12:44:02.784393+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:02.784393+0000","last_peered":"2024-01-24T12:44:02.784393+0000","last_clean":"2024-01-24T12:44:02.784393+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:02.784393+0000","last_undegraded":"2024-01-24T12:44:02.784393+0000","last_fullsized":"2024-01-24T12:44:02.784393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:10.897652+0000","last_change":"2024-01-24T12:44:10.897652+0000","last_active":"2024-01-24T12:44:10.897652+0000","last_peered":"2024-01-24T12:44:10.897652+0000","last_clean":"2024-01-24T12:44:10.897652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:10.897652+0000","last_undegraded":"2024-01-24T12:44:10.897652+0000","last_fullsized":"2024-01-24T12:44:10.897652+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-24T12:44:09.886602+0000","last_change":"2024-01-24T12:44:09.886602+0000","last_active":"2024-01-24T12:44:09.886602+0000","last_peered":"2024-01-24T12:44:09.886602+0000","last_clean":"2024-01-24T12:44:09.886602+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-24T12:44:09.886602+0000","last_undegraded":"2024-01-24T12:44:09.886602+0000","last_fullsized":"2024-01-24T12:44:09.886602+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:15.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:15.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.499+0000 7f383f78b640 1 Processor -- start 2024-01-24T12:44:15.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.499+0000 7f383f78b640 1 -- start start 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383f78b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380b8020 0x7f3838147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383f78b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3838070980 0x7f38381481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383f78b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838071550 con 0x7f38380bc340 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383f78b640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3838141d00 con 0x7f3838070980 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383f78b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3838071810 con 0x7f38380b8020 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3838070980 0x7f38381481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3838070980 0x7f38381481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59028/0 (socket says 172.21.15.27:59028) 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 -- 172.21.15.27:0/2832949589 learned_addr learned my addr 172.21.15.27:0/2832949589 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:15.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383cd26640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380b8020 0x7f3838147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 -- 172.21.15.27:0/2832949589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380b8020 msgr2=0x7f3838147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380b8020 0x7f3838147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 -- 172.21.15.27:0/2832949589 >> v1:172.21.15.124:6789/0 conn(0x7f38380bc340 legacy=0x7f38381415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 -- 172.21.15.27:0/2832949589 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380bc720 con 0x7f3838070980 2024-01-24T12:44:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f383dd28640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f38381481a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3830009e50 tx=0x7f383001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d45d67c52f36dd2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f382bfff640 1 -- 172.21.15.27:0/2832949589 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300a64c0 con 0x7f3838070980 2024-01-24T12:44:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f382bfff640 1 -- 172.21.15.27:0/2832949589 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38300a6620 con 0x7f3838070980 2024-01-24T12:44:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.503+0000 7f382bfff640 1 -- 172.21.15.27:0/2832949589 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300a69b0 con 0x7f3838070980 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/2832949589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 msgr2=0x7f38381481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f38381481a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3830009e50 tx=0x7f383001c940 comp rx=0 tx=0).stop 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/2832949589 shutdown_connections 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f38381481a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- 172.21.15.27:0/2832949589 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380b8020 0x7f3838147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/2832949589 >> 172.21.15.27:0/2832949589 conn(0x7f3838069ef0 msgr2=0x7f383806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/2832949589 shutdown_connections 2024-01-24T12:44:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/2832949589 wait complete. 2024-01-24T12:44:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 Processor -- start 2024-01-24T12:44:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- start start 2024-01-24T12:44:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38380b8020 0x7f38381e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380bc340 0x7f38381e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383813a1b0 con 0x7f3838070980 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38381355f0 con 0x7f38380b8020 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380ba000 con 0x7f38380bc340 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59042/0 (socket says 172.21.15.27:59042) 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 -- 172.21.15.27:0/1389364831 learned_addr learned my addr 172.21.15.27:0/1389364831 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383dd28640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380bc340 0x7f38381e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 -- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380bc340 msgr2=0x7f38381e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380bc340 0x7f38381e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383cd26640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38380b8020 0x7f38381e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 -- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38380b8020 msgr2=0x7f38381e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38380b8020 0x7f38381e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 -- 172.21.15.27:0/1389364831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009b30 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383d527640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c480 tx=0x7f382c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c012830 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0129b0 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383813a3e0 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c012d60 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383813a9a0 con 0x7f3838070980 2024-01-24T12:44:15.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.507+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383813abc0 con 0x7f3838070980 2024-01-24T12:44:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.511+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f382c01c460 con 0x7f3838070980 2024-01-24T12:44:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.511+0000 7f3829ffb640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 0x7f381c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.511+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f382c083190 con 0x7f3838070980 2024-01-24T12:44:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.511+0000 7f383cd26640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 0x7f381c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.511+0000 7f383cd26640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 0x7f381c067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3838071d20 tx=0x7f3834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.515+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f382c050ab0 con 0x7f3838070980 2024-01-24T12:44:15.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.667+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f383804e000 con 0x7f381c065a60 2024-01-24T12:44:15.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.687+0000 7f3829ffb640 1 -- 172.21.15.27:0/1389364831 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f383804e000 con 0x7f381c065a60 2024-01-24T12:44:15.689 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:15.691 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 msgr2=0x7f381c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 0x7f381c067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3838071d20 tx=0x7f3834008040 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 msgr2=0x7f3838137200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c480 tx=0x7f382c00c940 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 shutdown_connections 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f381c065a60 0x7f381c067f20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38380bc340 0x7f38381e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38380b8020 0x7f38381e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 --2- 172.21.15.27:0/1389364831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3838070980 0x7f3838137200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 >> 172.21.15.27:0/1389364831 conn(0x7f3838069ef0 msgr2=0x7f383814abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 shutdown_connections 2024-01-24T12:44:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.691+0000 7f383f78b640 1 -- 172.21.15.27:0/1389364831 wait complete. 2024-01-24T12:44:15.707 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-24T12:44:15.621625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720836"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310364+0000","last_change":"2024-01-24T12:44:11.346047+0000","last_active":"2024-01-24T12:44:12.310364+0000","last_peered":"2024-01-24T12:44:12.310364+0000","last_clean":"2024-01-24T12:44:12.310364+0000","last_became_active":"2024-01-24T12:44:11.345291+0000","last_became_peered":"2024-01-24T12:44:11.345291+0000","last_unstale":"2024-01-24T12:44:12.310364+0000","last_undegraded":"2024-01-24T12:44:12.310364+0000","last_fullsized":"2024-01-24T12:44:12.310364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308731+0000","last_change":"2024-01-24T12:44:11.311127+0000","last_active":"2024-01-24T12:44:12.308731+0000","last_peered":"2024-01-24T12:44:12.308731+0000","last_clean":"2024-01-24T12:44:12.308731+0000","last_became_active":"2024-01-24T12:44:11.310860+0000","last_became_peered":"2024-01-24T12:44:11.310860+0000","last_unstale":"2024-01-24T12:44:12.308731+0000","last_undegraded":"2024-01-24T12:44:12.308731+0000","last_fullsized":"2024-01-24T12:44:12.308731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306766+0000","last_change":"2024-01-24T12:44:11.304106+0000","last_active":"2024-01-24T12:44:12.306766+0000","last_peered":"2024-01-24T12:44:12.306766+0000","last_clean":"2024-01-24T12:44:12.306766+0000","last_became_active":"2024-01-24T12:44:11.303766+0000","last_became_peered":"2024-01-24T12:44:11.303766+0000","last_unstale":"2024-01-24T12:44:12.306766+0000","last_undegraded":"2024-01-24T12:44:12.306766+0000","last_fullsized":"2024-01-24T12:44:12.306766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308433+0000","last_change":"2024-01-24T12:44:11.344843+0000","last_active":"2024-01-24T12:44:12.308433+0000","last_peered":"2024-01-24T12:44:12.308433+0000","last_clean":"2024-01-24T12:44:12.308433+0000","last_became_active":"2024-01-24T12:44:11.342895+0000","last_became_peered":"2024-01-24T12:44:11.342895+0000","last_unstale":"2024-01-24T12:44:12.308433+0000","last_undegraded":"2024-01-24T12:44:12.308433+0000","last_fullsized":"2024-01-24T12:44:12.308433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309684+0000","last_change":"2024-01-24T12:44:11.350959+0000","last_active":"2024-01-24T12:44:12.309684+0000","last_peered":"2024-01-24T12:44:12.309684+0000","last_clean":"2024-01-24T12:44:12.309684+0000","last_became_active":"2024-01-24T12:44:11.350348+0000","last_became_peered":"2024-01-24T12:44:11.350348+0000","last_unstale":"2024-01-24T12:44:12.309684+0000","last_undegraded":"2024-01-24T12:44:12.309684+0000","last_fullsized":"2024-01-24T12:44:12.309684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308183+0000","last_change":"2024-01-24T12:44:11.356890+0000","last_active":"2024-01-24T12:44:12.308183+0000","last_peered":"2024-01-24T12:44:12.308183+0000","last_clean":"2024-01-24T12:44:12.308183+0000","last_became_active":"2024-01-24T12:44:11.356294+0000","last_became_peered":"2024-01-24T12:44:11.356294+0000","last_unstale":"2024-01-24T12:44:12.308183+0000","last_undegraded":"2024-01-24T12:44:12.308183+0000","last_fullsized":"2024-01-24T12:44:12.308183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308450+0000","last_change":"2024-01-24T12:44:11.338748+0000","last_active":"2024-01-24T12:44:12.308450+0000","last_peered":"2024-01-24T12:44:12.308450+0000","last_clean":"2024-01-24T12:44:12.308450+0000","last_became_active":"2024-01-24T12:44:11.337933+0000","last_became_peered":"2024-01-24T12:44:11.337933+0000","last_unstale":"2024-01-24T12:44:12.308450+0000","last_undegraded":"2024-01-24T12:44:12.308450+0000","last_fullsized":"2024-01-24T12:44:12.308450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295959+0000","last_change":"2024-01-24T12:44:11.356535+0000","last_active":"2024-01-24T12:44:12.295959+0000","last_peered":"2024-01-24T12:44:12.295959+0000","last_clean":"2024-01-24T12:44:12.295959+0000","last_became_active":"2024-01-24T12:44:11.356329+0000","last_became_peered":"2024-01-24T12:44:11.356329+0000","last_unstale":"2024-01-24T12:44:12.295959+0000","last_undegraded":"2024-01-24T12:44:12.295959+0000","last_fullsized":"2024-01-24T12:44:12.295959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310566+0000","last_change":"2024-01-24T12:44:11.358761+0000","last_active":"2024-01-24T12:44:12.310566+0000","last_peered":"2024-01-24T12:44:12.310566+0000","last_clean":"2024-01-24T12:44:12.310566+0000","last_became_active":"2024-01-24T12:44:11.358193+0000","last_became_peered":"2024-01-24T12:44:11.358193+0000","last_unstale":"2024-01-24T12:44:12.310566+0000","last_undegraded":"2024-01-24T12:44:12.310566+0000","last_fullsized":"2024-01-24T12:44:12.310566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298433+0000","last_change":"2024-01-24T12:44:11.344182+0000","last_active":"2024-01-24T12:44:12.298433+0000","last_peered":"2024-01-24T12:44:12.298433+0000","last_clean":"2024-01-24T12:44:12.298433+0000","last_became_active":"2024-01-24T12:44:11.343506+0000","last_became_peered":"2024-01-24T12:44:11.343506+0000","last_unstale":"2024-01-24T12:44:12.298433+0000","last_undegraded":"2024-01-24T12:44:12.298433+0000","last_fullsized":"2024-01-24T12:44:12.298433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297856+0000","last_change":"2024-01-24T12:44:11.356600+0000","last_active":"2024-01-24T12:44:12.297856+0000","last_peered":"2024-01-24T12:44:12.297856+0000","last_clean":"2024-01-24T12:44:12.297856+0000","last_became_active":"2024-01-24T12:44:11.355969+0000","last_became_peered":"2024-01-24T12:44:11.355969+0000","last_unstale":"2024-01-24T12:44:12.297856+0000","last_undegraded":"2024-01-24T12:44:12.297856+0000","last_fullsized":"2024-01-24T12:44:12.297856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300489+0000","last_change":"2024-01-24T12:44:11.323993+0000","last_active":"2024-01-24T12:44:12.300489+0000","last_peered":"2024-01-24T12:44:12.300489+0000","last_clean":"2024-01-24T12:44:12.300489+0000","last_became_active":"2024-01-24T12:44:11.323228+0000","last_became_peered":"2024-01-24T12:44:11.323228+0000","last_unstale":"2024-01-24T12:44:12.300489+0000","last_undegraded":"2024-01-24T12:44:12.300489+0000","last_fullsized":"2024-01-24T12:44:12.300489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296421+0000","last_change":"2024-01-24T12:44:11.333852+0000","last_active":"2024-01-24T12:44:12.296421+0000","last_peered":"2024-01-24T12:44:12.296421+0000","last_clean":"2024-01-24T12:44:12.296421+0000","last_became_active":"2024-01-24T12:44:11.333515+0000","last_became_peered":"2024-01-24T12:44:11.333515+0000","last_unstale":"2024-01-24T12:44:12.296421+0000","last_undegraded":"2024-01-24T12:44:12.296421+0000","last_fullsized":"2024-01-24T12:44:12.296421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306748+0000","last_change":"2024-01-24T12:44:11.303301+0000","last_active":"2024-01-24T12:44:12.306748+0000","last_peered":"2024-01-24T12:44:12.306748+0000","last_clean":"2024-01-24T12:44:12.306748+0000","last_became_active":"2024-01-24T12:44:11.303019+0000","last_became_peered":"2024-01-24T12:44:11.303019+0000","last_unstale":"2024-01-24T12:44:12.306748+0000","last_undegraded":"2024-01-24T12:44:12.306748+0000","last_fullsized":"2024-01-24T12:44:12.306748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:27:22.445760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307701+0000","last_change":"2024-01-24T12:44:11.335600+0000","last_active":"2024-01-24T12:44:12.307701+0000","last_peered":"2024-01-24T12:44:12.307701+0000","last_clean":"2024-01-24T12:44:12.307701+0000","last_became_active":"2024-01-24T12:44:11.335242+0000","last_became_peered":"2024-01-24T12:44:11.335242+0000","last_unstale":"2024-01-24T12:44:12.307701+0000","last_undegraded":"2024-01-24T12:44:12.307701+0000","last_fullsized":"2024-01-24T12:44:12.307701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309464+0000","last_change":"2024-01-24T12:44:11.355761+0000","last_active":"2024-01-24T12:44:12.309464+0000","last_peered":"2024-01-24T12:44:12.309464+0000","last_clean":"2024-01-24T12:44:12.309464+0000","last_became_active":"2024-01-24T12:44:11.355005+0000","last_became_peered":"2024-01-24T12:44:11.355005+0000","last_unstale":"2024-01-24T12:44:12.309464+0000","last_undegraded":"2024-01-24T12:44:12.309464+0000","last_fullsized":"2024-01-24T12:44:12.309464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309115+0000","last_change":"2024-01-24T12:44:11.342686+0000","last_active":"2024-01-24T12:44:12.309115+0000","last_peered":"2024-01-24T12:44:12.309115+0000","last_clean":"2024-01-24T12:44:12.309115+0000","last_became_active":"2024-01-24T12:44:11.341936+0000","last_became_peered":"2024-01-24T12:44:11.341936+0000","last_unstale":"2024-01-24T12:44:12.309115+0000","last_undegraded":"2024-01-24T12:44:12.309115+0000","last_fullsized":"2024-01-24T12:44:12.309115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307772+0000","last_change":"2024-01-24T12:44:11.333755+0000","last_active":"2024-01-24T12:44:12.307772+0000","last_peered":"2024-01-24T12:44:12.307772+0000","last_clean":"2024-01-24T12:44:12.307772+0000","last_became_active":"2024-01-24T12:44:11.333446+0000","last_became_peered":"2024-01-24T12:44:11.333446+0000","last_unstale":"2024-01-24T12:44:12.307772+0000","last_undegraded":"2024-01-24T12:44:12.307772+0000","last_fullsized":"2024-01-24T12:44:12.307772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310343+0000","last_change":"2024-01-24T12:44:11.351739+0000","last_active":"2024-01-24T12:44:12.310343+0000","last_peered":"2024-01-24T12:44:12.310343+0000","last_clean":"2024-01-24T12:44:12.310343+0000","last_became_active":"2024-01-24T12:44:11.350438+0000","last_became_peered":"2024-01-24T12:44:11.350438+0000","last_unstale":"2024-01-24T12:44:12.310343+0000","last_undegraded":"2024-01-24T12:44:12.310343+0000","last_fullsized":"2024-01-24T12:44:12.310343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297822+0000","last_change":"2024-01-24T12:44:11.328405+0000","last_active":"2024-01-24T12:44:12.297822+0000","last_peered":"2024-01-24T12:44:12.297822+0000","last_clean":"2024-01-24T12:44:12.297822+0000","last_became_active":"2024-01-24T12:44:11.327290+0000","last_became_peered":"2024-01-24T12:44:11.327290+0000","last_unstale":"2024-01-24T12:44:12.297822+0000","last_undegraded":"2024-01-24T12:44:12.297822+0000","last_fullsized":"2024-01-24T12:44:12.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307157+0000","last_change":"2024-01-24T12:44:11.338647+0000","last_active":"2024-01-24T12:44:12.307157+0000","last_peered":"2024-01-24T12:44:12.307157+0000","last_clean":"2024-01-24T12:44:12.307157+0000","last_became_active":"2024-01-24T12:44:11.338384+0000","last_became_peered":"2024-01-24T12:44:11.338384+0000","last_unstale":"2024-01-24T12:44:12.307157+0000","last_undegraded":"2024-01-24T12:44:12.307157+0000","last_fullsized":"2024-01-24T12:44:12.307157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308232+0000","last_change":"2024-01-24T12:44:11.355653+0000","last_active":"2024-01-24T12:44:12.308232+0000","last_peered":"2024-01-24T12:44:12.308232+0000","last_clean":"2024-01-24T12:44:12.308232+0000","last_became_active":"2024-01-24T12:44:11.354823+0000","last_became_peered":"2024-01-24T12:44:11.354823+0000","last_unstale":"2024-01-24T12:44:12.308232+0000","last_undegraded":"2024-01-24T12:44:12.308232+0000","last_fullsized":"2024-01-24T12:44:12.308232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296174+0000","last_change":"2024-01-24T12:44:11.323202+0000","last_active":"2024-01-24T12:44:12.296174+0000","last_peered":"2024-01-24T12:44:12.296174+0000","last_clean":"2024-01-24T12:44:12.296174+0000","last_became_active":"2024-01-24T12:44:11.322874+0000","last_became_peered":"2024-01-24T12:44:11.322874+0000","last_unstale":"2024-01-24T12:44:12.296174+0000","last_undegraded":"2024-01-24T12:44:12.296174+0000","last_fullsized":"2024-01-24T12:44:12.296174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308180+0000","last_change":"2024-01-24T12:44:11.354498+0000","last_active":"2024-01-24T12:44:12.308180+0000","last_peered":"2024-01-24T12:44:12.308180+0000","last_clean":"2024-01-24T12:44:12.308180+0000","last_became_active":"2024-01-24T12:44:11.353885+0000","last_became_peered":"2024-01-24T12:44:11.353885+0000","last_unstale":"2024-01-24T12:44:12.308180+0000","last_undegraded":"2024-01-24T12:44:12.308180+0000","last_fullsized":"2024-01-24T12:44:12.308180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296059+0000","last_change":"2024-01-24T12:44:11.326023+0000","last_active":"2024-01-24T12:44:12.296059+0000","last_peered":"2024-01-24T12:44:12.296059+0000","last_clean":"2024-01-24T12:44:12.296059+0000","last_became_active":"2024-01-24T12:44:11.325817+0000","last_became_peered":"2024-01-24T12:44:11.325817+0000","last_unstale":"2024-01-24T12:44:12.296059+0000","last_undegraded":"2024-01-24T12:44:12.296059+0000","last_fullsized":"2024-01-24T12:44:12.296059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298514+0000","last_change":"2024-01-24T12:44:11.340890+0000","last_active":"2024-01-24T12:44:12.298514+0000","last_peered":"2024-01-24T12:44:12.298514+0000","last_clean":"2024-01-24T12:44:12.298514+0000","last_became_active":"2024-01-24T12:44:11.340032+0000","last_became_peered":"2024-01-24T12:44:11.340032+0000","last_unstale":"2024-01-24T12:44:12.298514+0000","last_undegraded":"2024-01-24T12:44:12.298514+0000","last_fullsized":"2024-01-24T12:44:12.298514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308552+0000","last_change":"2024-01-24T12:44:11.304881+0000","last_active":"2024-01-24T12:44:12.308552+0000","last_peered":"2024-01-24T12:44:12.308552+0000","last_clean":"2024-01-24T12:44:12.308552+0000","last_became_active":"2024-01-24T12:44:11.304584+0000","last_became_peered":"2024-01-24T12:44:11.304584+0000","last_unstale":"2024-01-24T12:44:12.308552+0000","last_undegraded":"2024-01-24T12:44:12.308552+0000","last_fullsized":"2024-01-24T12:44:12.308552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296302+0000","last_change":"2024-01-24T12:44:11.325073+0000","last_active":"2024-01-24T12:44:12.296302+0000","last_peered":"2024-01-24T12:44:12.296302+0000","last_clean":"2024-01-24T12:44:12.296302+0000","last_became_active":"2024-01-24T12:44:11.324807+0000","last_became_peered":"2024-01-24T12:44:11.324807+0000","last_unstale":"2024-01-24T12:44:12.296302+0000","last_undegraded":"2024-01-24T12:44:12.296302+0000","last_fullsized":"2024-01-24T12:44:12.296302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307195+0000","last_change":"2024-01-24T12:44:11.303436+0000","last_active":"2024-01-24T12:44:12.307195+0000","last_peered":"2024-01-24T12:44:12.307195+0000","last_clean":"2024-01-24T12:44:12.307195+0000","last_became_active":"2024-01-24T12:44:11.303191+0000","last_became_peered":"2024-01-24T12:44:11.303191+0000","last_unstale":"2024-01-24T12:44:12.307195+0000","last_undegraded":"2024-01-24T12:44:12.307195+0000","last_fullsized":"2024-01-24T12:44:12.307195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308464+0000","last_change":"2024-01-24T12:44:11.355739+0000","last_active":"2024-01-24T12:44:12.308464+0000","last_peered":"2024-01-24T12:44:12.308464+0000","last_clean":"2024-01-24T12:44:12.308464+0000","last_became_active":"2024-01-24T12:44:11.354956+0000","last_became_peered":"2024-01-24T12:44:11.354956+0000","last_unstale":"2024-01-24T12:44:12.308464+0000","last_undegraded":"2024-01-24T12:44:12.308464+0000","last_fullsized":"2024-01-24T12:44:12.308464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307893+0000","last_change":"2024-01-24T12:44:11.341356+0000","last_active":"2024-01-24T12:44:12.307893+0000","last_peered":"2024-01-24T12:44:12.307893+0000","last_clean":"2024-01-24T12:44:12.307893+0000","last_became_active":"2024-01-24T12:44:11.341002+0000","last_became_peered":"2024-01-24T12:44:11.341002+0000","last_unstale":"2024-01-24T12:44:12.307893+0000","last_undegraded":"2024-01-24T12:44:12.307893+0000","last_fullsized":"2024-01-24T12:44:12.307893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297329+0000","last_change":"2024-01-24T12:44:11.318461+0000","last_active":"2024-01-24T12:44:12.297329+0000","last_peered":"2024-01-24T12:44:12.297329+0000","last_clean":"2024-01-24T12:44:12.297329+0000","last_became_active":"2024-01-24T12:44:11.317738+0000","last_became_peered":"2024-01-24T12:44:11.317738+0000","last_unstale":"2024-01-24T12:44:12.297329+0000","last_undegraded":"2024-01-24T12:44:12.297329+0000","last_fullsized":"2024-01-24T12:44:12.297329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299592+0000","last_change":"2024-01-24T12:44:11.324214+0000","last_active":"2024-01-24T12:44:12.299592+0000","last_peered":"2024-01-24T12:44:12.299592+0000","last_clean":"2024-01-24T12:44:12.299592+0000","last_became_active":"2024-01-24T12:44:11.323445+0000","last_became_peered":"2024-01-24T12:44:11.323445+0000","last_unstale":"2024-01-24T12:44:12.299592+0000","last_undegraded":"2024-01-24T12:44:12.299592+0000","last_fullsized":"2024-01-24T12:44:12.299592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296576+0000","last_change":"2024-01-24T12:44:10.955244+0000","last_active":"2024-01-24T12:44:12.296576+0000","last_peered":"2024-01-24T12:44:12.296576+0000","last_clean":"2024-01-24T12:44:12.296576+0000","last_became_active":"2024-01-24T12:44:10.954900+0000","last_became_peered":"2024-01-24T12:44:10.954900+0000","last_unstale":"2024-01-24T12:44:12.296576+0000","last_undegraded":"2024-01-24T12:44:12.296576+0000","last_fullsized":"2024-01-24T12:44:12.296576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307282+0000","last_change":"2024-01-24T12:44:11.322525+0000","last_active":"2024-01-24T12:44:12.307282+0000","last_peered":"2024-01-24T12:44:12.307282+0000","last_clean":"2024-01-24T12:44:12.307282+0000","last_became_active":"2024-01-24T12:44:11.322196+0000","last_became_peered":"2024-01-24T12:44:11.322196+0000","last_unstale":"2024-01-24T12:44:12.307282+0000","last_undegraded":"2024-01-24T12:44:12.307282+0000","last_fullsized":"2024-01-24T12:44:12.307282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297693+0000","last_change":"2024-01-24T12:44:10.938016+0000","last_active":"2024-01-24T12:44:12.297693+0000","last_peered":"2024-01-24T12:44:12.297693+0000","last_clean":"2024-01-24T12:44:12.297693+0000","last_became_active":"2024-01-24T12:44:10.937051+0000","last_became_peered":"2024-01-24T12:44:10.937051+0000","last_unstale":"2024-01-24T12:44:12.297693+0000","last_undegraded":"2024-01-24T12:44:12.297693+0000","last_fullsized":"2024-01-24T12:44:12.297693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296065+0000","last_change":"2024-01-24T12:44:10.944973+0000","last_active":"2024-01-24T12:44:12.296065+0000","last_peered":"2024-01-24T12:44:12.296065+0000","last_clean":"2024-01-24T12:44:12.296065+0000","last_became_active":"2024-01-24T12:44:10.944391+0000","last_became_peered":"2024-01-24T12:44:10.944391+0000","last_unstale":"2024-01-24T12:44:12.296065+0000","last_undegraded":"2024-01-24T12:44:12.296065+0000","last_fullsized":"2024-01-24T12:44:12.296065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296241+0000","last_change":"2024-01-24T12:44:11.306739+0000","last_active":"2024-01-24T12:44:12.296241+0000","last_peered":"2024-01-24T12:44:12.296241+0000","last_clean":"2024-01-24T12:44:12.296241+0000","last_became_active":"2024-01-24T12:44:11.306515+0000","last_became_peered":"2024-01-24T12:44:11.306515+0000","last_unstale":"2024-01-24T12:44:12.296241+0000","last_undegraded":"2024-01-24T12:44:12.296241+0000","last_fullsized":"2024-01-24T12:44:12.296241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308408+0000","last_change":"2024-01-24T12:44:10.937679+0000","last_active":"2024-01-24T12:44:12.308408+0000","last_peered":"2024-01-24T12:44:12.308408+0000","last_clean":"2024-01-24T12:44:12.308408+0000","last_became_active":"2024-01-24T12:44:10.936808+0000","last_became_peered":"2024-01-24T12:44:10.936808+0000","last_unstale":"2024-01-24T12:44:12.308408+0000","last_undegraded":"2024-01-24T12:44:12.308408+0000","last_fullsized":"2024-01-24T12:44:12.308408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307614+0000","last_change":"2024-01-24T12:44:11.305203+0000","last_active":"2024-01-24T12:44:12.307614+0000","last_peered":"2024-01-24T12:44:12.307614+0000","last_clean":"2024-01-24T12:44:12.307614+0000","last_became_active":"2024-01-24T12:44:11.304919+0000","last_became_peered":"2024-01-24T12:44:11.304919+0000","last_unstale":"2024-01-24T12:44:12.307614+0000","last_undegraded":"2024-01-24T12:44:12.307614+0000","last_fullsized":"2024-01-24T12:44:12.307614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298446+0000","last_change":"2024-01-24T12:44:10.949242+0000","last_active":"2024-01-24T12:44:12.298446+0000","last_peered":"2024-01-24T12:44:12.298446+0000","last_clean":"2024-01-24T12:44:12.298446+0000","last_became_active":"2024-01-24T12:44:10.948044+0000","last_became_peered":"2024-01-24T12:44:10.948044+0000","last_unstale":"2024-01-24T12:44:12.298446+0000","last_undegraded":"2024-01-24T12:44:12.298446+0000","last_fullsized":"2024-01-24T12:44:12.298446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308948+0000","last_change":"2024-01-24T12:44:11.346554+0000","last_active":"2024-01-24T12:44:12.308948+0000","last_peered":"2024-01-24T12:44:12.308948+0000","last_clean":"2024-01-24T12:44:12.308948+0000","last_became_active":"2024-01-24T12:44:11.345775+0000","last_became_peered":"2024-01-24T12:44:11.345775+0000","last_unstale":"2024-01-24T12:44:12.308948+0000","last_undegraded":"2024-01-24T12:44:12.308948+0000","last_fullsized":"2024-01-24T12:44:12.308948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309141+0000","last_change":"2024-01-24T12:44:10.944636+0000","last_active":"2024-01-24T12:44:12.309141+0000","last_peered":"2024-01-24T12:44:12.309141+0000","last_clean":"2024-01-24T12:44:12.309141+0000","last_became_active":"2024-01-24T12:44:10.943901+0000","last_became_peered":"2024-01-24T12:44:10.943901+0000","last_unstale":"2024-01-24T12:44:12.309141+0000","last_undegraded":"2024-01-24T12:44:12.309141+0000","last_fullsized":"2024-01-24T12:44:12.309141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307177+0000","last_change":"2024-01-24T12:44:11.343815+0000","last_active":"2024-01-24T12:44:12.307177+0000","last_peered":"2024-01-24T12:44:12.307177+0000","last_clean":"2024-01-24T12:44:12.307177+0000","last_became_active":"2024-01-24T12:44:11.343536+0000","last_became_peered":"2024-01-24T12:44:11.343536+0000","last_unstale":"2024-01-24T12:44:12.307177+0000","last_undegraded":"2024-01-24T12:44:12.307177+0000","last_fullsized":"2024-01-24T12:44:12.307177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.948117+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.947825+0000","last_became_peered":"2024-01-24T12:44:10.947825+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300676+0000","last_change":"2024-01-24T12:44:11.340824+0000","last_active":"2024-01-24T12:44:12.300676+0000","last_peered":"2024-01-24T12:44:12.300676+0000","last_clean":"2024-01-24T12:44:12.300676+0000","last_became_active":"2024-01-24T12:44:11.340194+0000","last_became_peered":"2024-01-24T12:44:11.340194+0000","last_unstale":"2024-01-24T12:44:12.300676+0000","last_undegraded":"2024-01-24T12:44:12.300676+0000","last_fullsized":"2024-01-24T12:44:12.300676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297929+0000","last_change":"2024-01-24T12:44:10.932460+0000","last_active":"2024-01-24T12:44:12.297929+0000","last_peered":"2024-01-24T12:44:12.297929+0000","last_clean":"2024-01-24T12:44:12.297929+0000","last_became_active":"2024-01-24T12:44:10.931678+0000","last_became_peered":"2024-01-24T12:44:10.931678+0000","last_unstale":"2024-01-24T12:44:12.297929+0000","last_undegraded":"2024-01-24T12:44:12.297929+0000","last_fullsized":"2024-01-24T12:44:12.297929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310013+0000","last_change":"2024-01-24T12:44:11.338493+0000","last_active":"2024-01-24T12:44:12.310013+0000","last_peered":"2024-01-24T12:44:12.310013+0000","last_clean":"2024-01-24T12:44:12.310013+0000","last_became_active":"2024-01-24T12:44:11.337805+0000","last_became_peered":"2024-01-24T12:44:11.337805+0000","last_unstale":"2024-01-24T12:44:12.310013+0000","last_undegraded":"2024-01-24T12:44:12.310013+0000","last_fullsized":"2024-01-24T12:44:12.310013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307465+0000","last_change":"2024-01-24T12:44:10.948122+0000","last_active":"2024-01-24T12:44:12.307465+0000","last_peered":"2024-01-24T12:44:12.307465+0000","last_clean":"2024-01-24T12:44:12.307465+0000","last_became_active":"2024-01-24T12:44:10.947868+0000","last_became_peered":"2024-01-24T12:44:10.947868+0000","last_unstale":"2024-01-24T12:44:12.307465+0000","last_undegraded":"2024-01-24T12:44:12.307465+0000","last_fullsized":"2024-01-24T12:44:12.307465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306691+0000","last_change":"2024-01-24T12:44:11.338719+0000","last_active":"2024-01-24T12:44:12.306691+0000","last_peered":"2024-01-24T12:44:12.306691+0000","last_clean":"2024-01-24T12:44:12.306691+0000","last_became_active":"2024-01-24T12:44:11.338420+0000","last_became_peered":"2024-01-24T12:44:11.338420+0000","last_unstale":"2024-01-24T12:44:12.306691+0000","last_undegraded":"2024-01-24T12:44:12.306691+0000","last_fullsized":"2024-01-24T12:44:12.306691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308469+0000","last_change":"2024-01-24T12:44:10.942141+0000","last_active":"2024-01-24T12:44:12.308469+0000","last_peered":"2024-01-24T12:44:12.308469+0000","last_clean":"2024-01-24T12:44:12.308469+0000","last_became_active":"2024-01-24T12:44:10.940912+0000","last_became_peered":"2024-01-24T12:44:10.940912+0000","last_unstale":"2024-01-24T12:44:12.308469+0000","last_undegraded":"2024-01-24T12:44:12.308469+0000","last_fullsized":"2024-01-24T12:44:12.308469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309938+0000","last_change":"2024-01-24T12:44:11.351939+0000","last_active":"2024-01-24T12:44:12.309938+0000","last_peered":"2024-01-24T12:44:12.309938+0000","last_clean":"2024-01-24T12:44:12.309938+0000","last_became_active":"2024-01-24T12:44:11.351433+0000","last_became_peered":"2024-01-24T12:44:11.351433+0000","last_unstale":"2024-01-24T12:44:12.309938+0000","last_undegraded":"2024-01-24T12:44:12.309938+0000","last_fullsized":"2024-01-24T12:44:12.309938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297489+0000","last_change":"2024-01-24T12:44:10.937971+0000","last_active":"2024-01-24T12:44:12.297489+0000","last_peered":"2024-01-24T12:44:12.297489+0000","last_clean":"2024-01-24T12:44:12.297489+0000","last_became_active":"2024-01-24T12:44:10.937130+0000","last_became_peered":"2024-01-24T12:44:10.937130+0000","last_unstale":"2024-01-24T12:44:12.297489+0000","last_undegraded":"2024-01-24T12:44:12.297489+0000","last_fullsized":"2024-01-24T12:44:12.297489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297341+0000","last_change":"2024-01-24T12:44:11.317998+0000","last_active":"2024-01-24T12:44:12.297341+0000","last_peered":"2024-01-24T12:44:12.297341+0000","last_clean":"2024-01-24T12:44:12.297341+0000","last_became_active":"2024-01-24T12:44:11.313220+0000","last_became_peered":"2024-01-24T12:44:11.313220+0000","last_unstale":"2024-01-24T12:44:12.297341+0000","last_undegraded":"2024-01-24T12:44:12.297341+0000","last_fullsized":"2024-01-24T12:44:12.297341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307832+0000","last_change":"2024-01-24T12:44:10.935739+0000","last_active":"2024-01-24T12:44:12.307832+0000","last_peered":"2024-01-24T12:44:12.307832+0000","last_clean":"2024-01-24T12:44:12.307832+0000","last_became_active":"2024-01-24T12:44:10.935329+0000","last_became_peered":"2024-01-24T12:44:10.935329+0000","last_unstale":"2024-01-24T12:44:12.307832+0000","last_undegraded":"2024-01-24T12:44:12.307832+0000","last_fullsized":"2024-01-24T12:44:12.307832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309364+0000","last_change":"2024-01-24T12:44:11.344235+0000","last_active":"2024-01-24T12:44:12.309364+0000","last_peered":"2024-01-24T12:44:12.309364+0000","last_clean":"2024-01-24T12:44:12.309364+0000","last_became_active":"2024-01-24T12:44:11.343638+0000","last_became_peered":"2024-01-24T12:44:11.343638+0000","last_unstale":"2024-01-24T12:44:12.309364+0000","last_undegraded":"2024-01-24T12:44:12.309364+0000","last_fullsized":"2024-01-24T12:44:12.309364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:43.676453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300535+0000","last_change":"2024-01-24T12:44:10.934962+0000","last_active":"2024-01-24T12:44:12.300535+0000","last_peered":"2024-01-24T12:44:12.300535+0000","last_clean":"2024-01-24T12:44:12.300535+0000","last_became_active":"2024-01-24T12:44:10.934179+0000","last_became_peered":"2024-01-24T12:44:10.934179+0000","last_unstale":"2024-01-24T12:44:12.300535+0000","last_undegraded":"2024-01-24T12:44:12.300535+0000","last_fullsized":"2024-01-24T12:44:12.300535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310395+0000","last_change":"2024-01-24T12:44:11.345146+0000","last_active":"2024-01-24T12:44:12.310395+0000","last_peered":"2024-01-24T12:44:12.310395+0000","last_clean":"2024-01-24T12:44:12.310395+0000","last_became_active":"2024-01-24T12:44:11.343454+0000","last_became_peered":"2024-01-24T12:44:11.343454+0000","last_unstale":"2024-01-24T12:44:12.310395+0000","last_undegraded":"2024-01-24T12:44:12.310395+0000","last_fullsized":"2024-01-24T12:44:12.310395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:45:06.184578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308221+0000","last_change":"2024-01-24T12:44:10.941647+0000","last_active":"2024-01-24T12:44:12.308221+0000","last_peered":"2024-01-24T12:44:12.308221+0000","last_clean":"2024-01-24T12:44:12.308221+0000","last_became_active":"2024-01-24T12:44:10.941177+0000","last_became_peered":"2024-01-24T12:44:10.941177+0000","last_unstale":"2024-01-24T12:44:12.308221+0000","last_undegraded":"2024-01-24T12:44:12.308221+0000","last_fullsized":"2024-01-24T12:44:12.308221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310690+0000","last_change":"2024-01-24T12:44:11.350856+0000","last_active":"2024-01-24T12:44:12.310690+0000","last_peered":"2024-01-24T12:44:12.310690+0000","last_clean":"2024-01-24T12:44:12.310690+0000","last_became_active":"2024-01-24T12:44:11.350244+0000","last_became_peered":"2024-01-24T12:44:11.350244+0000","last_unstale":"2024-01-24T12:44:12.310690+0000","last_undegraded":"2024-01-24T12:44:12.310690+0000","last_fullsized":"2024-01-24T12:44:12.310690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:31:04.636860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308635+0000","last_change":"2024-01-24T12:44:10.937540+0000","last_active":"2024-01-24T12:44:12.308635+0000","last_peered":"2024-01-24T12:44:12.308635+0000","last_clean":"2024-01-24T12:44:12.308635+0000","last_became_active":"2024-01-24T12:44:10.937246+0000","last_became_peered":"2024-01-24T12:44:10.937246+0000","last_unstale":"2024-01-24T12:44:12.308635+0000","last_undegraded":"2024-01-24T12:44:12.308635+0000","last_fullsized":"2024-01-24T12:44:12.308635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309138+0000","last_change":"2024-01-24T12:44:11.345714+0000","last_active":"2024-01-24T12:44:12.309138+0000","last_peered":"2024-01-24T12:44:12.309138+0000","last_clean":"2024-01-24T12:44:12.309138+0000","last_became_active":"2024-01-24T12:44:11.340127+0000","last_became_peered":"2024-01-24T12:44:11.340127+0000","last_unstale":"2024-01-24T12:44:12.309138+0000","last_undegraded":"2024-01-24T12:44:12.309138+0000","last_fullsized":"2024-01-24T12:44:12.309138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307978+0000","last_change":"2024-01-24T12:44:10.946919+0000","last_active":"2024-01-24T12:44:12.307978+0000","last_peered":"2024-01-24T12:44:12.307978+0000","last_clean":"2024-01-24T12:44:12.307978+0000","last_became_active":"2024-01-24T12:44:10.946607+0000","last_became_peered":"2024-01-24T12:44:10.946607+0000","last_unstale":"2024-01-24T12:44:12.307978+0000","last_undegraded":"2024-01-24T12:44:12.307978+0000","last_fullsized":"2024-01-24T12:44:12.307978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310112+0000","last_change":"2024-01-24T12:44:11.357380+0000","last_active":"2024-01-24T12:44:12.310112+0000","last_peered":"2024-01-24T12:44:12.310112+0000","last_clean":"2024-01-24T12:44:12.310112+0000","last_became_active":"2024-01-24T12:44:11.356720+0000","last_became_peered":"2024-01-24T12:44:11.356720+0000","last_unstale":"2024-01-24T12:44:12.310112+0000","last_undegraded":"2024-01-24T12:44:12.310112+0000","last_fullsized":"2024-01-24T12:44:12.310112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-24T12:44:11.307644+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:11.307644+0000","last_peered":"2024-01-24T12:44:11.307644+0000","last_clean":"2024-01-24T12:44:11.307644+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:11.307644+0000","last_undegraded":"2024-01-24T12:44:11.307644+0000","last_fullsized":"2024-01-24T12:44:11.307644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309210+0000","last_change":"2024-01-24T12:44:10.932841+0000","last_active":"2024-01-24T12:44:12.309210+0000","last_peered":"2024-01-24T12:44:12.309210+0000","last_clean":"2024-01-24T12:44:12.309210+0000","last_became_active":"2024-01-24T12:44:10.931862+0000","last_became_peered":"2024-01-24T12:44:10.931862+0000","last_unstale":"2024-01-24T12:44:12.309210+0000","last_undegraded":"2024-01-24T12:44:12.309210+0000","last_fullsized":"2024-01-24T12:44:12.309210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295950+0000","last_change":"2024-01-24T12:44:11.356544+0000","last_active":"2024-01-24T12:44:12.295950+0000","last_peered":"2024-01-24T12:44:12.295950+0000","last_clean":"2024-01-24T12:44:12.295950+0000","last_became_active":"2024-01-24T12:44:11.356289+0000","last_became_peered":"2024-01-24T12:44:11.356289+0000","last_unstale":"2024-01-24T12:44:12.295950+0000","last_undegraded":"2024-01-24T12:44:12.295950+0000","last_fullsized":"2024-01-24T12:44:12.295950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.954636+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.953755+0000","last_became_peered":"2024-01-24T12:44:10.953755+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306843+0000","last_change":"2024-01-24T12:44:11.322569+0000","last_active":"2024-01-24T12:44:12.306843+0000","last_peered":"2024-01-24T12:44:12.306843+0000","last_clean":"2024-01-24T12:44:12.306843+0000","last_became_active":"2024-01-24T12:44:11.322253+0000","last_became_peered":"2024-01-24T12:44:11.322253+0000","last_unstale":"2024-01-24T12:44:12.306843+0000","last_undegraded":"2024-01-24T12:44:12.306843+0000","last_fullsized":"2024-01-24T12:44:12.306843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308008+0000","last_change":"2024-01-24T12:44:10.941900+0000","last_active":"2024-01-24T12:44:12.308008+0000","last_peered":"2024-01-24T12:44:12.308008+0000","last_clean":"2024-01-24T12:44:12.308008+0000","last_became_active":"2024-01-24T12:44:10.941526+0000","last_became_peered":"2024-01-24T12:44:10.941526+0000","last_unstale":"2024-01-24T12:44:12.308008+0000","last_undegraded":"2024-01-24T12:44:12.308008+0000","last_fullsized":"2024-01-24T12:44:12.308008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307635+0000","last_change":"2024-01-24T12:44:11.306700+0000","last_active":"2024-01-24T12:44:12.307635+0000","last_peered":"2024-01-24T12:44:12.307635+0000","last_clean":"2024-01-24T12:44:12.307635+0000","last_became_active":"2024-01-24T12:44:11.306420+0000","last_became_peered":"2024-01-24T12:44:11.306420+0000","last_unstale":"2024-01-24T12:44:12.307635+0000","last_undegraded":"2024-01-24T12:44:12.307635+0000","last_fullsized":"2024-01-24T12:44:12.307635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308705+0000","last_change":"2024-01-24T12:44:10.939127+0000","last_active":"2024-01-24T12:44:12.308705+0000","last_peered":"2024-01-24T12:44:12.308705+0000","last_clean":"2024-01-24T12:44:12.308705+0000","last_became_active":"2024-01-24T12:44:10.936034+0000","last_became_peered":"2024-01-24T12:44:10.936034+0000","last_unstale":"2024-01-24T12:44:12.308705+0000","last_undegraded":"2024-01-24T12:44:12.308705+0000","last_fullsized":"2024-01-24T12:44:12.308705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300705+0000","last_change":"2024-01-24T12:44:11.326553+0000","last_active":"2024-01-24T12:44:12.300705+0000","last_peered":"2024-01-24T12:44:12.300705+0000","last_clean":"2024-01-24T12:44:12.300705+0000","last_became_active":"2024-01-24T12:44:11.322735+0000","last_became_peered":"2024-01-24T12:44:11.322735+0000","last_unstale":"2024-01-24T12:44:12.300705+0000","last_undegraded":"2024-01-24T12:44:12.300705+0000","last_fullsized":"2024-01-24T12:44:12.300705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308725+0000","last_change":"2024-01-24T12:44:10.932249+0000","last_active":"2024-01-24T12:44:12.308725+0000","last_peered":"2024-01-24T12:44:12.308725+0000","last_clean":"2024-01-24T12:44:12.308725+0000","last_became_active":"2024-01-24T12:44:10.931916+0000","last_became_peered":"2024-01-24T12:44:10.931916+0000","last_unstale":"2024-01-24T12:44:12.308725+0000","last_undegraded":"2024-01-24T12:44:12.308725+0000","last_fullsized":"2024-01-24T12:44:12.308725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308828+0000","last_change":"2024-01-24T12:44:11.341472+0000","last_active":"2024-01-24T12:44:12.308828+0000","last_peered":"2024-01-24T12:44:12.308828+0000","last_clean":"2024-01-24T12:44:12.308828+0000","last_became_active":"2024-01-24T12:44:11.339574+0000","last_became_peered":"2024-01-24T12:44:11.339574+0000","last_unstale":"2024-01-24T12:44:12.308828+0000","last_undegraded":"2024-01-24T12:44:12.308828+0000","last_fullsized":"2024-01-24T12:44:12.308828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310484+0000","last_change":"2024-01-24T12:44:10.954824+0000","last_active":"2024-01-24T12:44:12.310484+0000","last_peered":"2024-01-24T12:44:12.310484+0000","last_clean":"2024-01-24T12:44:12.310484+0000","last_became_active":"2024-01-24T12:44:10.953995+0000","last_became_peered":"2024-01-24T12:44:10.953995+0000","last_unstale":"2024-01-24T12:44:12.310484+0000","last_undegraded":"2024-01-24T12:44:12.310484+0000","last_fullsized":"2024-01-24T12:44:12.310484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:46.778299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308748+0000","last_change":"2024-01-24T12:44:11.306822+0000","last_active":"2024-01-24T12:44:12.308748+0000","last_peered":"2024-01-24T12:44:12.308748+0000","last_clean":"2024-01-24T12:44:12.308748+0000","last_became_active":"2024-01-24T12:44:11.306582+0000","last_became_peered":"2024-01-24T12:44:11.306582+0000","last_unstale":"2024-01-24T12:44:12.308748+0000","last_undegraded":"2024-01-24T12:44:12.308748+0000","last_fullsized":"2024-01-24T12:44:12.308748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308811+0000","last_change":"2024-01-24T12:44:10.945081+0000","last_active":"2024-01-24T12:44:12.308811+0000","last_peered":"2024-01-24T12:44:12.308811+0000","last_clean":"2024-01-24T12:44:12.308811+0000","last_became_active":"2024-01-24T12:44:10.944818+0000","last_became_peered":"2024-01-24T12:44:10.944818+0000","last_unstale":"2024-01-24T12:44:12.308811+0000","last_undegraded":"2024-01-24T12:44:12.308811+0000","last_fullsized":"2024-01-24T12:44:12.308811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296235+0000","last_change":"2024-01-24T12:44:11.338803+0000","last_active":"2024-01-24T12:44:12.296235+0000","last_peered":"2024-01-24T12:44:12.296235+0000","last_clean":"2024-01-24T12:44:12.296235+0000","last_became_active":"2024-01-24T12:44:11.338477+0000","last_became_peered":"2024-01-24T12:44:11.338477+0000","last_unstale":"2024-01-24T12:44:12.296235+0000","last_undegraded":"2024-01-24T12:44:12.296235+0000","last_fullsized":"2024-01-24T12:44:12.296235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298588+0000","last_change":"2024-01-24T12:44:10.939339+0000","last_active":"2024-01-24T12:44:12.298588+0000","last_peered":"2024-01-24T12:44:12.298588+0000","last_clean":"2024-01-24T12:44:12.298588+0000","last_became_active":"2024-01-24T12:44:10.938406+0000","last_became_peered":"2024-01-24T12:44:10.938406+0000","last_unstale":"2024-01-24T12:44:12.298588+0000","last_undegraded":"2024-01-24T12:44:12.298588+0000","last_fullsized":"2024-01-24T12:44:12.298588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307008+0000","last_change":"2024-01-24T12:44:11.302425+0000","last_active":"2024-01-24T12:44:12.307008+0000","last_peered":"2024-01-24T12:44:12.307008+0000","last_clean":"2024-01-24T12:44:12.307008+0000","last_became_active":"2024-01-24T12:44:11.302126+0000","last_became_peered":"2024-01-24T12:44:11.302126+0000","last_unstale":"2024-01-24T12:44:12.307008+0000","last_undegraded":"2024-01-24T12:44:12.307008+0000","last_fullsized":"2024-01-24T12:44:12.307008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308420+0000","last_change":"2024-01-24T12:44:10.954419+0000","last_active":"2024-01-24T12:44:12.308420+0000","last_peered":"2024-01-24T12:44:12.308420+0000","last_clean":"2024-01-24T12:44:12.308420+0000","last_became_active":"2024-01-24T12:44:10.953740+0000","last_became_peered":"2024-01-24T12:44:10.953740+0000","last_unstale":"2024-01-24T12:44:12.308420+0000","last_undegraded":"2024-01-24T12:44:12.308420+0000","last_fullsized":"2024-01-24T12:44:12.308420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:41.145058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299297+0000","last_change":"2024-01-24T12:44:11.323414+0000","last_active":"2024-01-24T12:44:12.299297+0000","last_peered":"2024-01-24T12:44:12.299297+0000","last_clean":"2024-01-24T12:44:12.299297+0000","last_became_active":"2024-01-24T12:44:11.321676+0000","last_became_peered":"2024-01-24T12:44:11.321676+0000","last_unstale":"2024-01-24T12:44:12.299297+0000","last_undegraded":"2024-01-24T12:44:12.299297+0000","last_fullsized":"2024-01-24T12:44:12.299297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:24.995947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308370+0000","last_change":"2024-01-24T12:44:10.932826+0000","last_active":"2024-01-24T12:44:12.308370+0000","last_peered":"2024-01-24T12:44:12.308370+0000","last_clean":"2024-01-24T12:44:12.308370+0000","last_became_active":"2024-01-24T12:44:10.931858+0000","last_became_peered":"2024-01-24T12:44:10.931858+0000","last_unstale":"2024-01-24T12:44:12.308370+0000","last_undegraded":"2024-01-24T12:44:12.308370+0000","last_fullsized":"2024-01-24T12:44:12.308370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296392+0000","last_change":"2024-01-24T12:44:11.305338+0000","last_active":"2024-01-24T12:44:12.296392+0000","last_peered":"2024-01-24T12:44:12.296392+0000","last_clean":"2024-01-24T12:44:12.296392+0000","last_became_active":"2024-01-24T12:44:11.305113+0000","last_became_peered":"2024-01-24T12:44:11.305113+0000","last_unstale":"2024-01-24T12:44:12.296392+0000","last_undegraded":"2024-01-24T12:44:12.296392+0000","last_fullsized":"2024-01-24T12:44:12.296392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308535+0000","last_change":"2024-01-24T12:44:10.943496+0000","last_active":"2024-01-24T12:44:12.308535+0000","last_peered":"2024-01-24T12:44:12.308535+0000","last_clean":"2024-01-24T12:44:12.308535+0000","last_became_active":"2024-01-24T12:44:10.943191+0000","last_became_peered":"2024-01-24T12:44:10.943191+0000","last_unstale":"2024-01-24T12:44:12.308535+0000","last_undegraded":"2024-01-24T12:44:12.308535+0000","last_fullsized":"2024-01-24T12:44:12.308535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296559+0000","last_change":"2024-01-24T12:44:11.306336+0000","last_active":"2024-01-24T12:44:12.296559+0000","last_peered":"2024-01-24T12:44:12.296559+0000","last_clean":"2024-01-24T12:44:12.296559+0000","last_became_active":"2024-01-24T12:44:11.306052+0000","last_became_peered":"2024-01-24T12:44:11.306052+0000","last_unstale":"2024-01-24T12:44:12.296559+0000","last_undegraded":"2024-01-24T12:44:12.296559+0000","last_fullsized":"2024-01-24T12:44:12.296559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310071+0000","last_change":"2024-01-24T12:44:10.959081+0000","last_active":"2024-01-24T12:44:12.310071+0000","last_peered":"2024-01-24T12:44:12.310071+0000","last_clean":"2024-01-24T12:44:12.310071+0000","last_became_active":"2024-01-24T12:44:10.956226+0000","last_became_peered":"2024-01-24T12:44:10.956226+0000","last_unstale":"2024-01-24T12:44:12.310071+0000","last_undegraded":"2024-01-24T12:44:12.310071+0000","last_fullsized":"2024-01-24T12:44:12.310071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:37.678733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297441+0000","last_change":"2024-01-24T12:44:11.335329+0000","last_active":"2024-01-24T12:44:12.297441+0000","last_peered":"2024-01-24T12:44:12.297441+0000","last_clean":"2024-01-24T12:44:12.297441+0000","last_became_active":"2024-01-24T12:44:11.334560+0000","last_became_peered":"2024-01-24T12:44:11.334560+0000","last_unstale":"2024-01-24T12:44:12.297441+0000","last_undegraded":"2024-01-24T12:44:12.297441+0000","last_fullsized":"2024-01-24T12:44:12.297441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309208+0000","last_change":"2024-01-24T12:44:11.357364+0000","last_active":"2024-01-24T12:44:12.309208+0000","last_peered":"2024-01-24T12:44:12.309208+0000","last_clean":"2024-01-24T12:44:12.309208+0000","last_became_active":"2024-01-24T12:44:11.354163+0000","last_became_peered":"2024-01-24T12:44:11.354163+0000","last_unstale":"2024-01-24T12:44:12.309208+0000","last_undegraded":"2024-01-24T12:44:12.309208+0000","last_fullsized":"2024-01-24T12:44:12.309208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309831+0000","last_change":"2024-01-24T12:44:10.954300+0000","last_active":"2024-01-24T12:44:12.309831+0000","last_peered":"2024-01-24T12:44:12.309831+0000","last_clean":"2024-01-24T12:44:12.309831+0000","last_became_active":"2024-01-24T12:44:10.953779+0000","last_became_peered":"2024-01-24T12:44:10.953779+0000","last_unstale":"2024-01-24T12:44:12.309831+0000","last_undegraded":"2024-01-24T12:44:12.309831+0000","last_fullsized":"2024-01-24T12:44:12.309831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:58.271375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308883+0000","last_change":"2024-01-24T12:44:11.343616+0000","last_active":"2024-01-24T12:44:12.308883+0000","last_peered":"2024-01-24T12:44:12.308883+0000","last_clean":"2024-01-24T12:44:12.308883+0000","last_became_active":"2024-01-24T12:44:11.342012+0000","last_became_peered":"2024-01-24T12:44:11.342012+0000","last_unstale":"2024-01-24T12:44:12.308883+0000","last_undegraded":"2024-01-24T12:44:12.308883+0000","last_fullsized":"2024-01-24T12:44:12.308883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310244+0000","last_change":"2024-01-24T12:44:10.956362+0000","last_active":"2024-01-24T12:44:12.310244+0000","last_peered":"2024-01-24T12:44:12.310244+0000","last_clean":"2024-01-24T12:44:12.310244+0000","last_became_active":"2024-01-24T12:44:10.955703+0000","last_became_peered":"2024-01-24T12:44:10.955703+0000","last_unstale":"2024-01-24T12:44:12.310244+0000","last_undegraded":"2024-01-24T12:44:12.310244+0000","last_fullsized":"2024-01-24T12:44:12.310244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:23.984897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307009+0000","last_change":"2024-01-24T12:44:11.356491+0000","last_active":"2024-01-24T12:44:12.307009+0000","last_peered":"2024-01-24T12:44:12.307009+0000","last_clean":"2024-01-24T12:44:12.307009+0000","last_became_active":"2024-01-24T12:44:11.356182+0000","last_became_peered":"2024-01-24T12:44:11.356182+0000","last_unstale":"2024-01-24T12:44:12.307009+0000","last_undegraded":"2024-01-24T12:44:12.307009+0000","last_fullsized":"2024-01-24T12:44:12.307009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296190+0000","last_change":"2024-01-24T12:44:10.934690+0000","last_active":"2024-01-24T12:44:12.296190+0000","last_peered":"2024-01-24T12:44:12.296190+0000","last_clean":"2024-01-24T12:44:12.296190+0000","last_became_active":"2024-01-24T12:44:10.934221+0000","last_became_peered":"2024-01-24T12:44:10.934221+0000","last_unstale":"2024-01-24T12:44:12.296190+0000","last_undegraded":"2024-01-24T12:44:12.296190+0000","last_fullsized":"2024-01-24T12:44:12.296190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296123+0000","last_change":"2024-01-24T12:44:11.333832+0000","last_active":"2024-01-24T12:44:12.296123+0000","last_peered":"2024-01-24T12:44:12.296123+0000","last_clean":"2024-01-24T12:44:12.296123+0000","last_became_active":"2024-01-24T12:44:11.333545+0000","last_became_peered":"2024-01-24T12:44:11.333545+0000","last_unstale":"2024-01-24T12:44:12.296123+0000","last_undegraded":"2024-01-24T12:44:12.296123+0000","last_fullsized":"2024-01-24T12:44:12.296123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307335+0000","last_change":"2024-01-24T12:44:10.950192+0000","last_active":"2024-01-24T12:44:12.307335+0000","last_peered":"2024-01-24T12:44:12.307335+0000","last_clean":"2024-01-24T12:44:12.307335+0000","last_became_active":"2024-01-24T12:44:10.949914+0000","last_became_peered":"2024-01-24T12:44:10.949914+0000","last_unstale":"2024-01-24T12:44:12.307335+0000","last_undegraded":"2024-01-24T12:44:12.307335+0000","last_fullsized":"2024-01-24T12:44:12.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:15.711 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-24T12:44:15.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 Processor -- start 2024-01-24T12:44:15.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 -- start start 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1f440b8020 0x7f1f44147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1f44070980 0x7f1f441481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f44071550 con 0x7f1f440bc340 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f44141d00 con 0x7f1f440b8020 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f4b5cd640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f44071810 con 0x7f1f44070980 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f48b68640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1f440b8020 0x7f1f44147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f49369640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1f440bc340 0x7f1f441415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56364/0 (socket says 172.21.15.27:56364) 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f49369640 1 -- 172.21.15.27:0/3517414539 learned_addr learned my addr 172.21.15.27:0/3517414539 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f49b6a640 1 --2- 172.21.15.27:0/3517414539 >> v2:172.21.15.124:3300/0 conn(0x7f1f44070980 0x7f1f441481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f48b68640 1 -- 172.21.15.27:0/3517414539 >> v2:172.21.15.124:3300/0 conn(0x7f1f44070980 msgr2=0x7f1f441481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f48b68640 1 --2- 172.21.15.27:0/3517414539 >> v2:172.21.15.124:3300/0 conn(0x7f1f44070980 0x7f1f441481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f48b68640 1 -- 172.21.15.27:0/3517414539 >> v1:172.21.15.27:6789/0 conn(0x7f1f440bc340 legacy=0x7f1f441415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f43fff640 1 -- 172.21.15.27:0/3517414539 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611314247 0 0) 0x7f1f44071550 con 0x7f1f440bc340 2024-01-24T12:44:15.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.867+0000 7f1f48b68640 1 -- 172.21.15.27:0/3517414539 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440bc720 con 0x7f1f440b8020 2024-01-24T12:44:15.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f48b68640 1 --2- 172.21.15.27:0/3517414539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f44147c60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f44070590 tx=0x7f1f3801e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af908c0a37745a2a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f43fff640 1 -- 172.21.15.27:0/3517414539 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380ad600 con 0x7f1f440b8020 2024-01-24T12:44:15.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f43fff640 1 -- 172.21.15.27:0/3517414539 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f380a9050 con 0x7f1f440b8020 2024-01-24T12:44:15.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f43fff640 1 -- 172.21.15.27:0/3517414539 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380ad980 con 0x7f1f440b8020 2024-01-24T12:44:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3517414539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 msgr2=0x7f1f44147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3517414539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f44147c60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f44070590 tx=0x7f1f3801e5e0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3517414539 shutdown_connections 2024-01-24T12:44:15.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3517414539 >> v2:172.21.15.124:3300/0 conn(0x7f1f44070980 0x7f1f441481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3517414539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f44147c60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3517414539 >> 172.21.15.27:0/3517414539 conn(0x7f1f44069ef0 msgr2=0x7f1f4406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:15.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3517414539 shutdown_connections 2024-01-24T12:44:15.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3517414539 wait complete. 2024-01-24T12:44:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 Processor -- start 2024-01-24T12:44:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.871+0000 7f1f4b5cd640 1 -- start start 2024-01-24T12:44:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 0x7f1f440b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 0x7f1f441de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440b5a90 con 0x7f1f440b8020 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44148bb0 con 0x7f1f44070980 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4413cf70 con 0x7f1f440bc340 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59062/0 (socket says 172.21.15.27:59062) 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 -- 172.21.15.27:0/3271430690 learned_addr learned my addr 172.21.15.27:0/3271430690 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49369640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 0x7f1f440b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49b6a640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 0x7f1f441de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 -- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 msgr2=0x7f1f441de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 0x7f1f441de620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 -- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 msgr2=0x7f1f440b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 0x7f1f440b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 -- 172.21.15.27:0/3271430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009420 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49369640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 0x7f1f440b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49b6a640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 0x7f1f441de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f48b68640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f380b0040 tx=0x7f1f3801b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380b6840 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f380b69c0 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4413d250 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380b6d70 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f44149ef0 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44148d20 con 0x7f1f440b8020 2024-01-24T12:44:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f380b4040 con 0x7f1f440b8020 2024-01-24T12:44:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 0x7f1f30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f3811f490 con 0x7f1f440b8020 2024-01-24T12:44:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49369640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 0x7f1f30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.875+0000 7f1f49369640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 0x7f1f30067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0012f0 tx=0x7f1f3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:15.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:15.879+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1f380ecee0 con 0x7f1f440b8020 2024-01-24T12:44:16.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.091+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1f4404e000 con 0x7f1f440b8020 2024-01-24T12:44:16.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f41ffb640 1 -- 172.21.15.27:0/3271430690 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f1f380f0500 con 0x7f1f440b8020 2024-01-24T12:44:16.095 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:16.095 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1706100238,"num_in_osds":8,"osd_in_since":1706100229,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":224256000,"bytes_avail":772869857280,"bytes_total":773094113280,"write_bytes_sec":2505,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4260}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-01-24T12:43:47.000011+0000","services":{}},"progress_events":{}} 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 msgr2=0x7f1f30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 0x7f1f30067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0012f0 tx=0x7f1f3c009040 comp rx=0 tx=0).stop 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 msgr2=0x7f1f441de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f380b0040 tx=0x7f1f3801b380 comp rx=0 tx=0).stop 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 shutdown_connections 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1f30065a60 0x7f1f30067f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1f440bc340 0x7f1f441de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1f440b8020 0x7f1f441de0e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 --2- 172.21.15.27:0/3271430690 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1f44070980 0x7f1f440b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 >> 172.21.15.27:0/3271430690 conn(0x7f1f44069ef0 msgr2=0x7f1f440b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:16.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 shutdown_connections 2024-01-24T12:44:16.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.095+0000 7f1f4b5cd640 1 -- 172.21.15.27:0/3271430690 wait complete. 2024-01-24T12:44:16.113 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-24T12:44:16.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:16.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 Processor -- start 2024-01-24T12:44:16.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 -- start start 2024-01-24T12:44:16.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 0x7f4cf40658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4cf406acd0 0x7f4cf4155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf4065f50 con 0x7f4cf406a840 2024-01-24T12:44:16.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf4071000 con 0x7f4cf406acd0 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfbdcb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf4071cf0 con 0x7f4cf4144b60 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4cf406acd0 0x7f4cf4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf9366640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4cf406a840 0x7f4cf414e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:56370/0 (socket says 172.21.15.27:56370) 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf9366640 1 -- 172.21.15.27:0/3353661857 learned_addr learned my addr 172.21.15.27:0/3353661857 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf9b67640 1 --2- 172.21.15.27:0/3353661857 >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 0x7f4cf40658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 -- 172.21.15.27:0/3353661857 >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 msgr2=0x7f4cf40658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 --2- 172.21.15.27:0/3353661857 >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 0x7f4cf40658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 -- 172.21.15.27:0/3353661857 >> v1:172.21.15.27:6789/0 conn(0x7f4cf406a840 legacy=0x7f4cf414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf8b65640 1 -- 172.21.15.27:0/3353661857 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824820344 0 0) 0x7f4ce4001120 con 0x7f4cf406a840 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 -- 172.21.15.27:0/3353661857 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4070760 con 0x7f4cf406acd0 2024-01-24T12:44:16.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf9b67640 1 --2- 172.21.15.27:0/3353661857 >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 0x7f4cf40658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:16.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cfa368640 1 --2- 172.21.15.27:0/3353661857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf4155450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cf406bf20 tx=0x7f4cec01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198e6789c225e7c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:16.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.227+0000 7f4cf8b65640 1 -- 172.21.15.27:0/3353661857 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0a5910 con 0x7f4cf406acd0 2024-01-24T12:44:16.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf8b65640 1 -- 172.21.15.27:0/3353661857 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0a5a70 con 0x7f4cf406acd0 2024-01-24T12:44:16.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf8b65640 1 -- 172.21.15.27:0/3353661857 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0a5e00 con 0x7f4cf406acd0 2024-01-24T12:44:16.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3353661857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 msgr2=0x7f4cf4155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3353661857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf4155450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4cf406bf20 tx=0x7f4cec01c850 comp rx=0 tx=0).stop 2024-01-24T12:44:16.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3353661857 shutdown_connections 2024-01-24T12:44:16.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3353661857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf4155450 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3353661857 >> v2:172.21.15.124:3300/0 conn(0x7f4cf4144b60 0x7f4cf40658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3353661857 >> 172.21.15.27:0/3353661857 conn(0x7f4cf4069d20 msgr2=0x7f4cf406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:16.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3353661857 shutdown_connections 2024-01-24T12:44:16.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3353661857 wait complete. 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 Processor -- start 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- start start 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cf406a840 0x7f4cf414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cf4144b60 0x7f4cf4135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf414ddd0 con 0x7f4cf406acd0 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41e3090 con 0x7f4cf406a840 2024-01-24T12:44:16.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf414c190 con 0x7f4cf4144b60 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59090/0 (socket says 172.21.15.27:59090) 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 -- 172.21.15.27:0/3559665928 learned_addr learned my addr 172.21.15.27:0/3559665928 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfa368640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cf4144b60 0x7f4cf4135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9b67640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cf406a840 0x7f4cf414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 -- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cf4144b60 msgr2=0x7f4cf4135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cf4144b60 0x7f4cf4135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 -- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cf406a840 msgr2=0x7f4cf414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cf406a840 0x7f4cf414d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 -- 172.21.15.27:0/3559665928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec009a70 con 0x7f4cf406acd0 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cf9366640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c480 tx=0x7f4ce400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40074e0 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4007660 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf414c430 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4004a30 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf414c9f0 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.231+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf41e3240 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.235+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ce4004b90 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.235+0000 7f4cea7fc640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 0x7f4cd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.235+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce40820c0 con 0x7f4cf406acd0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.235+0000 7f4cf9b67640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 0x7f4cd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.235+0000 7f4cf9b67640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 0x7f4cd8067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006fd0 tx=0x7f4cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.239+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4cf41e3240 con 0x7f4cf406acd0 2024-01-24T12:44:16.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.383+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cf4144f40 con 0x7f4cd8065a60 2024-01-24T12:44:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.403+0000 7f4cea7fc640 1 -- 172.21.15.27:0/3559665928 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f4cf000c040 con 0x7f4cd8065a60 2024-01-24T12:44:16.408 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 msgr2=0x7f4cd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 0x7f4cd8067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006fd0 tx=0x7f4cf0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 msgr2=0x7f4cf413c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c480 tx=0x7f4ce400c940 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 shutdown_connections 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cd8065a60 0x7f4cd8067f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cf4144b60 0x7f4cf4135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cf406acd0 0x7f4cf413c210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 --2- 172.21.15.27:0/3559665928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cf406a840 0x7f4cf414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 >> 172.21.15.27:0/3559665928 conn(0x7f4cf4069d20 msgr2=0x7f4cf40b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:16.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 shutdown_connections 2024-01-24T12:44:16.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:16.407+0000 7f4cfbdcb640 1 -- 172.21.15.27:0/3559665928 wait complete. 2024-01-24T12:44:16.425 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-24T12:44:15.621625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.720836"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310364+0000","last_change":"2024-01-24T12:44:11.346047+0000","last_active":"2024-01-24T12:44:12.310364+0000","last_peered":"2024-01-24T12:44:12.310364+0000","last_clean":"2024-01-24T12:44:12.310364+0000","last_became_active":"2024-01-24T12:44:11.345291+0000","last_became_peered":"2024-01-24T12:44:11.345291+0000","last_unstale":"2024-01-24T12:44:12.310364+0000","last_undegraded":"2024-01-24T12:44:12.310364+0000","last_fullsized":"2024-01-24T12:44:12.310364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308731+0000","last_change":"2024-01-24T12:44:11.311127+0000","last_active":"2024-01-24T12:44:12.308731+0000","last_peered":"2024-01-24T12:44:12.308731+0000","last_clean":"2024-01-24T12:44:12.308731+0000","last_became_active":"2024-01-24T12:44:11.310860+0000","last_became_peered":"2024-01-24T12:44:11.310860+0000","last_unstale":"2024-01-24T12:44:12.308731+0000","last_undegraded":"2024-01-24T12:44:12.308731+0000","last_fullsized":"2024-01-24T12:44:12.308731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306766+0000","last_change":"2024-01-24T12:44:11.304106+0000","last_active":"2024-01-24T12:44:12.306766+0000","last_peered":"2024-01-24T12:44:12.306766+0000","last_clean":"2024-01-24T12:44:12.306766+0000","last_became_active":"2024-01-24T12:44:11.303766+0000","last_became_peered":"2024-01-24T12:44:11.303766+0000","last_unstale":"2024-01-24T12:44:12.306766+0000","last_undegraded":"2024-01-24T12:44:12.306766+0000","last_fullsized":"2024-01-24T12:44:12.306766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308433+0000","last_change":"2024-01-24T12:44:11.344843+0000","last_active":"2024-01-24T12:44:12.308433+0000","last_peered":"2024-01-24T12:44:12.308433+0000","last_clean":"2024-01-24T12:44:12.308433+0000","last_became_active":"2024-01-24T12:44:11.342895+0000","last_became_peered":"2024-01-24T12:44:11.342895+0000","last_unstale":"2024-01-24T12:44:12.308433+0000","last_undegraded":"2024-01-24T12:44:12.308433+0000","last_fullsized":"2024-01-24T12:44:12.308433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309684+0000","last_change":"2024-01-24T12:44:11.350959+0000","last_active":"2024-01-24T12:44:12.309684+0000","last_peered":"2024-01-24T12:44:12.309684+0000","last_clean":"2024-01-24T12:44:12.309684+0000","last_became_active":"2024-01-24T12:44:11.350348+0000","last_became_peered":"2024-01-24T12:44:11.350348+0000","last_unstale":"2024-01-24T12:44:12.309684+0000","last_undegraded":"2024-01-24T12:44:12.309684+0000","last_fullsized":"2024-01-24T12:44:12.309684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308183+0000","last_change":"2024-01-24T12:44:11.356890+0000","last_active":"2024-01-24T12:44:12.308183+0000","last_peered":"2024-01-24T12:44:12.308183+0000","last_clean":"2024-01-24T12:44:12.308183+0000","last_became_active":"2024-01-24T12:44:11.356294+0000","last_became_peered":"2024-01-24T12:44:11.356294+0000","last_unstale":"2024-01-24T12:44:12.308183+0000","last_undegraded":"2024-01-24T12:44:12.308183+0000","last_fullsized":"2024-01-24T12:44:12.308183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308450+0000","last_change":"2024-01-24T12:44:11.338748+0000","last_active":"2024-01-24T12:44:12.308450+0000","last_peered":"2024-01-24T12:44:12.308450+0000","last_clean":"2024-01-24T12:44:12.308450+0000","last_became_active":"2024-01-24T12:44:11.337933+0000","last_became_peered":"2024-01-24T12:44:11.337933+0000","last_unstale":"2024-01-24T12:44:12.308450+0000","last_undegraded":"2024-01-24T12:44:12.308450+0000","last_fullsized":"2024-01-24T12:44:12.308450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295959+0000","last_change":"2024-01-24T12:44:11.356535+0000","last_active":"2024-01-24T12:44:12.295959+0000","last_peered":"2024-01-24T12:44:12.295959+0000","last_clean":"2024-01-24T12:44:12.295959+0000","last_became_active":"2024-01-24T12:44:11.356329+0000","last_became_peered":"2024-01-24T12:44:11.356329+0000","last_unstale":"2024-01-24T12:44:12.295959+0000","last_undegraded":"2024-01-24T12:44:12.295959+0000","last_fullsized":"2024-01-24T12:44:12.295959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310566+0000","last_change":"2024-01-24T12:44:11.358761+0000","last_active":"2024-01-24T12:44:12.310566+0000","last_peered":"2024-01-24T12:44:12.310566+0000","last_clean":"2024-01-24T12:44:12.310566+0000","last_became_active":"2024-01-24T12:44:11.358193+0000","last_became_peered":"2024-01-24T12:44:11.358193+0000","last_unstale":"2024-01-24T12:44:12.310566+0000","last_undegraded":"2024-01-24T12:44:12.310566+0000","last_fullsized":"2024-01-24T12:44:12.310566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298433+0000","last_change":"2024-01-24T12:44:11.344182+0000","last_active":"2024-01-24T12:44:12.298433+0000","last_peered":"2024-01-24T12:44:12.298433+0000","last_clean":"2024-01-24T12:44:12.298433+0000","last_became_active":"2024-01-24T12:44:11.343506+0000","last_became_peered":"2024-01-24T12:44:11.343506+0000","last_unstale":"2024-01-24T12:44:12.298433+0000","last_undegraded":"2024-01-24T12:44:12.298433+0000","last_fullsized":"2024-01-24T12:44:12.298433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297856+0000","last_change":"2024-01-24T12:44:11.356600+0000","last_active":"2024-01-24T12:44:12.297856+0000","last_peered":"2024-01-24T12:44:12.297856+0000","last_clean":"2024-01-24T12:44:12.297856+0000","last_became_active":"2024-01-24T12:44:11.355969+0000","last_became_peered":"2024-01-24T12:44:11.355969+0000","last_unstale":"2024-01-24T12:44:12.297856+0000","last_undegraded":"2024-01-24T12:44:12.297856+0000","last_fullsized":"2024-01-24T12:44:12.297856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300489+0000","last_change":"2024-01-24T12:44:11.323993+0000","last_active":"2024-01-24T12:44:12.300489+0000","last_peered":"2024-01-24T12:44:12.300489+0000","last_clean":"2024-01-24T12:44:12.300489+0000","last_became_active":"2024-01-24T12:44:11.323228+0000","last_became_peered":"2024-01-24T12:44:11.323228+0000","last_unstale":"2024-01-24T12:44:12.300489+0000","last_undegraded":"2024-01-24T12:44:12.300489+0000","last_fullsized":"2024-01-24T12:44:12.300489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296421+0000","last_change":"2024-01-24T12:44:11.333852+0000","last_active":"2024-01-24T12:44:12.296421+0000","last_peered":"2024-01-24T12:44:12.296421+0000","last_clean":"2024-01-24T12:44:12.296421+0000","last_became_active":"2024-01-24T12:44:11.333515+0000","last_became_peered":"2024-01-24T12:44:11.333515+0000","last_unstale":"2024-01-24T12:44:12.296421+0000","last_undegraded":"2024-01-24T12:44:12.296421+0000","last_fullsized":"2024-01-24T12:44:12.296421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306748+0000","last_change":"2024-01-24T12:44:11.303301+0000","last_active":"2024-01-24T12:44:12.306748+0000","last_peered":"2024-01-24T12:44:12.306748+0000","last_clean":"2024-01-24T12:44:12.306748+0000","last_became_active":"2024-01-24T12:44:11.303019+0000","last_became_peered":"2024-01-24T12:44:11.303019+0000","last_unstale":"2024-01-24T12:44:12.306748+0000","last_undegraded":"2024-01-24T12:44:12.306748+0000","last_fullsized":"2024-01-24T12:44:12.306748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:27:22.445760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307701+0000","last_change":"2024-01-24T12:44:11.335600+0000","last_active":"2024-01-24T12:44:12.307701+0000","last_peered":"2024-01-24T12:44:12.307701+0000","last_clean":"2024-01-24T12:44:12.307701+0000","last_became_active":"2024-01-24T12:44:11.335242+0000","last_became_peered":"2024-01-24T12:44:11.335242+0000","last_unstale":"2024-01-24T12:44:12.307701+0000","last_undegraded":"2024-01-24T12:44:12.307701+0000","last_fullsized":"2024-01-24T12:44:12.307701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309464+0000","last_change":"2024-01-24T12:44:11.355761+0000","last_active":"2024-01-24T12:44:12.309464+0000","last_peered":"2024-01-24T12:44:12.309464+0000","last_clean":"2024-01-24T12:44:12.309464+0000","last_became_active":"2024-01-24T12:44:11.355005+0000","last_became_peered":"2024-01-24T12:44:11.355005+0000","last_unstale":"2024-01-24T12:44:12.309464+0000","last_undegraded":"2024-01-24T12:44:12.309464+0000","last_fullsized":"2024-01-24T12:44:12.309464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309115+0000","last_change":"2024-01-24T12:44:11.342686+0000","last_active":"2024-01-24T12:44:12.309115+0000","last_peered":"2024-01-24T12:44:12.309115+0000","last_clean":"2024-01-24T12:44:12.309115+0000","last_became_active":"2024-01-24T12:44:11.341936+0000","last_became_peered":"2024-01-24T12:44:11.341936+0000","last_unstale":"2024-01-24T12:44:12.309115+0000","last_undegraded":"2024-01-24T12:44:12.309115+0000","last_fullsized":"2024-01-24T12:44:12.309115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307772+0000","last_change":"2024-01-24T12:44:11.333755+0000","last_active":"2024-01-24T12:44:12.307772+0000","last_peered":"2024-01-24T12:44:12.307772+0000","last_clean":"2024-01-24T12:44:12.307772+0000","last_became_active":"2024-01-24T12:44:11.333446+0000","last_became_peered":"2024-01-24T12:44:11.333446+0000","last_unstale":"2024-01-24T12:44:12.307772+0000","last_undegraded":"2024-01-24T12:44:12.307772+0000","last_fullsized":"2024-01-24T12:44:12.307772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310343+0000","last_change":"2024-01-24T12:44:11.351739+0000","last_active":"2024-01-24T12:44:12.310343+0000","last_peered":"2024-01-24T12:44:12.310343+0000","last_clean":"2024-01-24T12:44:12.310343+0000","last_became_active":"2024-01-24T12:44:11.350438+0000","last_became_peered":"2024-01-24T12:44:11.350438+0000","last_unstale":"2024-01-24T12:44:12.310343+0000","last_undegraded":"2024-01-24T12:44:12.310343+0000","last_fullsized":"2024-01-24T12:44:12.310343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297822+0000","last_change":"2024-01-24T12:44:11.328405+0000","last_active":"2024-01-24T12:44:12.297822+0000","last_peered":"2024-01-24T12:44:12.297822+0000","last_clean":"2024-01-24T12:44:12.297822+0000","last_became_active":"2024-01-24T12:44:11.327290+0000","last_became_peered":"2024-01-24T12:44:11.327290+0000","last_unstale":"2024-01-24T12:44:12.297822+0000","last_undegraded":"2024-01-24T12:44:12.297822+0000","last_fullsized":"2024-01-24T12:44:12.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307157+0000","last_change":"2024-01-24T12:44:11.338647+0000","last_active":"2024-01-24T12:44:12.307157+0000","last_peered":"2024-01-24T12:44:12.307157+0000","last_clean":"2024-01-24T12:44:12.307157+0000","last_became_active":"2024-01-24T12:44:11.338384+0000","last_became_peered":"2024-01-24T12:44:11.338384+0000","last_unstale":"2024-01-24T12:44:12.307157+0000","last_undegraded":"2024-01-24T12:44:12.307157+0000","last_fullsized":"2024-01-24T12:44:12.307157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308232+0000","last_change":"2024-01-24T12:44:11.355653+0000","last_active":"2024-01-24T12:44:12.308232+0000","last_peered":"2024-01-24T12:44:12.308232+0000","last_clean":"2024-01-24T12:44:12.308232+0000","last_became_active":"2024-01-24T12:44:11.354823+0000","last_became_peered":"2024-01-24T12:44:11.354823+0000","last_unstale":"2024-01-24T12:44:12.308232+0000","last_undegraded":"2024-01-24T12:44:12.308232+0000","last_fullsized":"2024-01-24T12:44:12.308232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296174+0000","last_change":"2024-01-24T12:44:11.323202+0000","last_active":"2024-01-24T12:44:12.296174+0000","last_peered":"2024-01-24T12:44:12.296174+0000","last_clean":"2024-01-24T12:44:12.296174+0000","last_became_active":"2024-01-24T12:44:11.322874+0000","last_became_peered":"2024-01-24T12:44:11.322874+0000","last_unstale":"2024-01-24T12:44:12.296174+0000","last_undegraded":"2024-01-24T12:44:12.296174+0000","last_fullsized":"2024-01-24T12:44:12.296174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308180+0000","last_change":"2024-01-24T12:44:11.354498+0000","last_active":"2024-01-24T12:44:12.308180+0000","last_peered":"2024-01-24T12:44:12.308180+0000","last_clean":"2024-01-24T12:44:12.308180+0000","last_became_active":"2024-01-24T12:44:11.353885+0000","last_became_peered":"2024-01-24T12:44:11.353885+0000","last_unstale":"2024-01-24T12:44:12.308180+0000","last_undegraded":"2024-01-24T12:44:12.308180+0000","last_fullsized":"2024-01-24T12:44:12.308180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296059+0000","last_change":"2024-01-24T12:44:11.326023+0000","last_active":"2024-01-24T12:44:12.296059+0000","last_peered":"2024-01-24T12:44:12.296059+0000","last_clean":"2024-01-24T12:44:12.296059+0000","last_became_active":"2024-01-24T12:44:11.325817+0000","last_became_peered":"2024-01-24T12:44:11.325817+0000","last_unstale":"2024-01-24T12:44:12.296059+0000","last_undegraded":"2024-01-24T12:44:12.296059+0000","last_fullsized":"2024-01-24T12:44:12.296059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298514+0000","last_change":"2024-01-24T12:44:11.340890+0000","last_active":"2024-01-24T12:44:12.298514+0000","last_peered":"2024-01-24T12:44:12.298514+0000","last_clean":"2024-01-24T12:44:12.298514+0000","last_became_active":"2024-01-24T12:44:11.340032+0000","last_became_peered":"2024-01-24T12:44:11.340032+0000","last_unstale":"2024-01-24T12:44:12.298514+0000","last_undegraded":"2024-01-24T12:44:12.298514+0000","last_fullsized":"2024-01-24T12:44:12.298514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308552+0000","last_change":"2024-01-24T12:44:11.304881+0000","last_active":"2024-01-24T12:44:12.308552+0000","last_peered":"2024-01-24T12:44:12.308552+0000","last_clean":"2024-01-24T12:44:12.308552+0000","last_became_active":"2024-01-24T12:44:11.304584+0000","last_became_peered":"2024-01-24T12:44:11.304584+0000","last_unstale":"2024-01-24T12:44:12.308552+0000","last_undegraded":"2024-01-24T12:44:12.308552+0000","last_fullsized":"2024-01-24T12:44:12.308552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296302+0000","last_change":"2024-01-24T12:44:11.325073+0000","last_active":"2024-01-24T12:44:12.296302+0000","last_peered":"2024-01-24T12:44:12.296302+0000","last_clean":"2024-01-24T12:44:12.296302+0000","last_became_active":"2024-01-24T12:44:11.324807+0000","last_became_peered":"2024-01-24T12:44:11.324807+0000","last_unstale":"2024-01-24T12:44:12.296302+0000","last_undegraded":"2024-01-24T12:44:12.296302+0000","last_fullsized":"2024-01-24T12:44:12.296302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307195+0000","last_change":"2024-01-24T12:44:11.303436+0000","last_active":"2024-01-24T12:44:12.307195+0000","last_peered":"2024-01-24T12:44:12.307195+0000","last_clean":"2024-01-24T12:44:12.307195+0000","last_became_active":"2024-01-24T12:44:11.303191+0000","last_became_peered":"2024-01-24T12:44:11.303191+0000","last_unstale":"2024-01-24T12:44:12.307195+0000","last_undegraded":"2024-01-24T12:44:12.307195+0000","last_fullsized":"2024-01-24T12:44:12.307195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308464+0000","last_change":"2024-01-24T12:44:11.355739+0000","last_active":"2024-01-24T12:44:12.308464+0000","last_peered":"2024-01-24T12:44:12.308464+0000","last_clean":"2024-01-24T12:44:12.308464+0000","last_became_active":"2024-01-24T12:44:11.354956+0000","last_became_peered":"2024-01-24T12:44:11.354956+0000","last_unstale":"2024-01-24T12:44:12.308464+0000","last_undegraded":"2024-01-24T12:44:12.308464+0000","last_fullsized":"2024-01-24T12:44:12.308464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307893+0000","last_change":"2024-01-24T12:44:11.341356+0000","last_active":"2024-01-24T12:44:12.307893+0000","last_peered":"2024-01-24T12:44:12.307893+0000","last_clean":"2024-01-24T12:44:12.307893+0000","last_became_active":"2024-01-24T12:44:11.341002+0000","last_became_peered":"2024-01-24T12:44:11.341002+0000","last_unstale":"2024-01-24T12:44:12.307893+0000","last_undegraded":"2024-01-24T12:44:12.307893+0000","last_fullsized":"2024-01-24T12:44:12.307893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297329+0000","last_change":"2024-01-24T12:44:11.318461+0000","last_active":"2024-01-24T12:44:12.297329+0000","last_peered":"2024-01-24T12:44:12.297329+0000","last_clean":"2024-01-24T12:44:12.297329+0000","last_became_active":"2024-01-24T12:44:11.317738+0000","last_became_peered":"2024-01-24T12:44:11.317738+0000","last_unstale":"2024-01-24T12:44:12.297329+0000","last_undegraded":"2024-01-24T12:44:12.297329+0000","last_fullsized":"2024-01-24T12:44:12.297329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299592+0000","last_change":"2024-01-24T12:44:11.324214+0000","last_active":"2024-01-24T12:44:12.299592+0000","last_peered":"2024-01-24T12:44:12.299592+0000","last_clean":"2024-01-24T12:44:12.299592+0000","last_became_active":"2024-01-24T12:44:11.323445+0000","last_became_peered":"2024-01-24T12:44:11.323445+0000","last_unstale":"2024-01-24T12:44:12.299592+0000","last_undegraded":"2024-01-24T12:44:12.299592+0000","last_fullsized":"2024-01-24T12:44:12.299592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296576+0000","last_change":"2024-01-24T12:44:10.955244+0000","last_active":"2024-01-24T12:44:12.296576+0000","last_peered":"2024-01-24T12:44:12.296576+0000","last_clean":"2024-01-24T12:44:12.296576+0000","last_became_active":"2024-01-24T12:44:10.954900+0000","last_became_peered":"2024-01-24T12:44:10.954900+0000","last_unstale":"2024-01-24T12:44:12.296576+0000","last_undegraded":"2024-01-24T12:44:12.296576+0000","last_fullsized":"2024-01-24T12:44:12.296576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307282+0000","last_change":"2024-01-24T12:44:11.322525+0000","last_active":"2024-01-24T12:44:12.307282+0000","last_peered":"2024-01-24T12:44:12.307282+0000","last_clean":"2024-01-24T12:44:12.307282+0000","last_became_active":"2024-01-24T12:44:11.322196+0000","last_became_peered":"2024-01-24T12:44:11.322196+0000","last_unstale":"2024-01-24T12:44:12.307282+0000","last_undegraded":"2024-01-24T12:44:12.307282+0000","last_fullsized":"2024-01-24T12:44:12.307282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297693+0000","last_change":"2024-01-24T12:44:10.938016+0000","last_active":"2024-01-24T12:44:12.297693+0000","last_peered":"2024-01-24T12:44:12.297693+0000","last_clean":"2024-01-24T12:44:12.297693+0000","last_became_active":"2024-01-24T12:44:10.937051+0000","last_became_peered":"2024-01-24T12:44:10.937051+0000","last_unstale":"2024-01-24T12:44:12.297693+0000","last_undegraded":"2024-01-24T12:44:12.297693+0000","last_fullsized":"2024-01-24T12:44:12.297693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296065+0000","last_change":"2024-01-24T12:44:10.944973+0000","last_active":"2024-01-24T12:44:12.296065+0000","last_peered":"2024-01-24T12:44:12.296065+0000","last_clean":"2024-01-24T12:44:12.296065+0000","last_became_active":"2024-01-24T12:44:10.944391+0000","last_became_peered":"2024-01-24T12:44:10.944391+0000","last_unstale":"2024-01-24T12:44:12.296065+0000","last_undegraded":"2024-01-24T12:44:12.296065+0000","last_fullsized":"2024-01-24T12:44:12.296065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296241+0000","last_change":"2024-01-24T12:44:11.306739+0000","last_active":"2024-01-24T12:44:12.296241+0000","last_peered":"2024-01-24T12:44:12.296241+0000","last_clean":"2024-01-24T12:44:12.296241+0000","last_became_active":"2024-01-24T12:44:11.306515+0000","last_became_peered":"2024-01-24T12:44:11.306515+0000","last_unstale":"2024-01-24T12:44:12.296241+0000","last_undegraded":"2024-01-24T12:44:12.296241+0000","last_fullsized":"2024-01-24T12:44:12.296241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308408+0000","last_change":"2024-01-24T12:44:10.937679+0000","last_active":"2024-01-24T12:44:12.308408+0000","last_peered":"2024-01-24T12:44:12.308408+0000","last_clean":"2024-01-24T12:44:12.308408+0000","last_became_active":"2024-01-24T12:44:10.936808+0000","last_became_peered":"2024-01-24T12:44:10.936808+0000","last_unstale":"2024-01-24T12:44:12.308408+0000","last_undegraded":"2024-01-24T12:44:12.308408+0000","last_fullsized":"2024-01-24T12:44:12.308408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307614+0000","last_change":"2024-01-24T12:44:11.305203+0000","last_active":"2024-01-24T12:44:12.307614+0000","last_peered":"2024-01-24T12:44:12.307614+0000","last_clean":"2024-01-24T12:44:12.307614+0000","last_became_active":"2024-01-24T12:44:11.304919+0000","last_became_peered":"2024-01-24T12:44:11.304919+0000","last_unstale":"2024-01-24T12:44:12.307614+0000","last_undegraded":"2024-01-24T12:44:12.307614+0000","last_fullsized":"2024-01-24T12:44:12.307614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298446+0000","last_change":"2024-01-24T12:44:10.949242+0000","last_active":"2024-01-24T12:44:12.298446+0000","last_peered":"2024-01-24T12:44:12.298446+0000","last_clean":"2024-01-24T12:44:12.298446+0000","last_became_active":"2024-01-24T12:44:10.948044+0000","last_became_peered":"2024-01-24T12:44:10.948044+0000","last_unstale":"2024-01-24T12:44:12.298446+0000","last_undegraded":"2024-01-24T12:44:12.298446+0000","last_fullsized":"2024-01-24T12:44:12.298446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308948+0000","last_change":"2024-01-24T12:44:11.346554+0000","last_active":"2024-01-24T12:44:12.308948+0000","last_peered":"2024-01-24T12:44:12.308948+0000","last_clean":"2024-01-24T12:44:12.308948+0000","last_became_active":"2024-01-24T12:44:11.345775+0000","last_became_peered":"2024-01-24T12:44:11.345775+0000","last_unstale":"2024-01-24T12:44:12.308948+0000","last_undegraded":"2024-01-24T12:44:12.308948+0000","last_fullsized":"2024-01-24T12:44:12.308948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309141+0000","last_change":"2024-01-24T12:44:10.944636+0000","last_active":"2024-01-24T12:44:12.309141+0000","last_peered":"2024-01-24T12:44:12.309141+0000","last_clean":"2024-01-24T12:44:12.309141+0000","last_became_active":"2024-01-24T12:44:10.943901+0000","last_became_peered":"2024-01-24T12:44:10.943901+0000","last_unstale":"2024-01-24T12:44:12.309141+0000","last_undegraded":"2024-01-24T12:44:12.309141+0000","last_fullsized":"2024-01-24T12:44:12.309141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307177+0000","last_change":"2024-01-24T12:44:11.343815+0000","last_active":"2024-01-24T12:44:12.307177+0000","last_peered":"2024-01-24T12:44:12.307177+0000","last_clean":"2024-01-24T12:44:12.307177+0000","last_became_active":"2024-01-24T12:44:11.343536+0000","last_became_peered":"2024-01-24T12:44:11.343536+0000","last_unstale":"2024-01-24T12:44:12.307177+0000","last_undegraded":"2024-01-24T12:44:12.307177+0000","last_fullsized":"2024-01-24T12:44:12.307177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.948117+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.947825+0000","last_became_peered":"2024-01-24T12:44:10.947825+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300676+0000","last_change":"2024-01-24T12:44:11.340824+0000","last_active":"2024-01-24T12:44:12.300676+0000","last_peered":"2024-01-24T12:44:12.300676+0000","last_clean":"2024-01-24T12:44:12.300676+0000","last_became_active":"2024-01-24T12:44:11.340194+0000","last_became_peered":"2024-01-24T12:44:11.340194+0000","last_unstale":"2024-01-24T12:44:12.300676+0000","last_undegraded":"2024-01-24T12:44:12.300676+0000","last_fullsized":"2024-01-24T12:44:12.300676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297929+0000","last_change":"2024-01-24T12:44:10.932460+0000","last_active":"2024-01-24T12:44:12.297929+0000","last_peered":"2024-01-24T12:44:12.297929+0000","last_clean":"2024-01-24T12:44:12.297929+0000","last_became_active":"2024-01-24T12:44:10.931678+0000","last_became_peered":"2024-01-24T12:44:10.931678+0000","last_unstale":"2024-01-24T12:44:12.297929+0000","last_undegraded":"2024-01-24T12:44:12.297929+0000","last_fullsized":"2024-01-24T12:44:12.297929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310013+0000","last_change":"2024-01-24T12:44:11.338493+0000","last_active":"2024-01-24T12:44:12.310013+0000","last_peered":"2024-01-24T12:44:12.310013+0000","last_clean":"2024-01-24T12:44:12.310013+0000","last_became_active":"2024-01-24T12:44:11.337805+0000","last_became_peered":"2024-01-24T12:44:11.337805+0000","last_unstale":"2024-01-24T12:44:12.310013+0000","last_undegraded":"2024-01-24T12:44:12.310013+0000","last_fullsized":"2024-01-24T12:44:12.310013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307465+0000","last_change":"2024-01-24T12:44:10.948122+0000","last_active":"2024-01-24T12:44:12.307465+0000","last_peered":"2024-01-24T12:44:12.307465+0000","last_clean":"2024-01-24T12:44:12.307465+0000","last_became_active":"2024-01-24T12:44:10.947868+0000","last_became_peered":"2024-01-24T12:44:10.947868+0000","last_unstale":"2024-01-24T12:44:12.307465+0000","last_undegraded":"2024-01-24T12:44:12.307465+0000","last_fullsized":"2024-01-24T12:44:12.307465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306691+0000","last_change":"2024-01-24T12:44:11.338719+0000","last_active":"2024-01-24T12:44:12.306691+0000","last_peered":"2024-01-24T12:44:12.306691+0000","last_clean":"2024-01-24T12:44:12.306691+0000","last_became_active":"2024-01-24T12:44:11.338420+0000","last_became_peered":"2024-01-24T12:44:11.338420+0000","last_unstale":"2024-01-24T12:44:12.306691+0000","last_undegraded":"2024-01-24T12:44:12.306691+0000","last_fullsized":"2024-01-24T12:44:12.306691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308469+0000","last_change":"2024-01-24T12:44:10.942141+0000","last_active":"2024-01-24T12:44:12.308469+0000","last_peered":"2024-01-24T12:44:12.308469+0000","last_clean":"2024-01-24T12:44:12.308469+0000","last_became_active":"2024-01-24T12:44:10.940912+0000","last_became_peered":"2024-01-24T12:44:10.940912+0000","last_unstale":"2024-01-24T12:44:12.308469+0000","last_undegraded":"2024-01-24T12:44:12.308469+0000","last_fullsized":"2024-01-24T12:44:12.308469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309938+0000","last_change":"2024-01-24T12:44:11.351939+0000","last_active":"2024-01-24T12:44:12.309938+0000","last_peered":"2024-01-24T12:44:12.309938+0000","last_clean":"2024-01-24T12:44:12.309938+0000","last_became_active":"2024-01-24T12:44:11.351433+0000","last_became_peered":"2024-01-24T12:44:11.351433+0000","last_unstale":"2024-01-24T12:44:12.309938+0000","last_undegraded":"2024-01-24T12:44:12.309938+0000","last_fullsized":"2024-01-24T12:44:12.309938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297489+0000","last_change":"2024-01-24T12:44:10.937971+0000","last_active":"2024-01-24T12:44:12.297489+0000","last_peered":"2024-01-24T12:44:12.297489+0000","last_clean":"2024-01-24T12:44:12.297489+0000","last_became_active":"2024-01-24T12:44:10.937130+0000","last_became_peered":"2024-01-24T12:44:10.937130+0000","last_unstale":"2024-01-24T12:44:12.297489+0000","last_undegraded":"2024-01-24T12:44:12.297489+0000","last_fullsized":"2024-01-24T12:44:12.297489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297341+0000","last_change":"2024-01-24T12:44:11.317998+0000","last_active":"2024-01-24T12:44:12.297341+0000","last_peered":"2024-01-24T12:44:12.297341+0000","last_clean":"2024-01-24T12:44:12.297341+0000","last_became_active":"2024-01-24T12:44:11.313220+0000","last_became_peered":"2024-01-24T12:44:11.313220+0000","last_unstale":"2024-01-24T12:44:12.297341+0000","last_undegraded":"2024-01-24T12:44:12.297341+0000","last_fullsized":"2024-01-24T12:44:12.297341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307832+0000","last_change":"2024-01-24T12:44:10.935739+0000","last_active":"2024-01-24T12:44:12.307832+0000","last_peered":"2024-01-24T12:44:12.307832+0000","last_clean":"2024-01-24T12:44:12.307832+0000","last_became_active":"2024-01-24T12:44:10.935329+0000","last_became_peered":"2024-01-24T12:44:10.935329+0000","last_unstale":"2024-01-24T12:44:12.307832+0000","last_undegraded":"2024-01-24T12:44:12.307832+0000","last_fullsized":"2024-01-24T12:44:12.307832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309364+0000","last_change":"2024-01-24T12:44:11.344235+0000","last_active":"2024-01-24T12:44:12.309364+0000","last_peered":"2024-01-24T12:44:12.309364+0000","last_clean":"2024-01-24T12:44:12.309364+0000","last_became_active":"2024-01-24T12:44:11.343638+0000","last_became_peered":"2024-01-24T12:44:11.343638+0000","last_unstale":"2024-01-24T12:44:12.309364+0000","last_undegraded":"2024-01-24T12:44:12.309364+0000","last_fullsized":"2024-01-24T12:44:12.309364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:43.676453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300535+0000","last_change":"2024-01-24T12:44:10.934962+0000","last_active":"2024-01-24T12:44:12.300535+0000","last_peered":"2024-01-24T12:44:12.300535+0000","last_clean":"2024-01-24T12:44:12.300535+0000","last_became_active":"2024-01-24T12:44:10.934179+0000","last_became_peered":"2024-01-24T12:44:10.934179+0000","last_unstale":"2024-01-24T12:44:12.300535+0000","last_undegraded":"2024-01-24T12:44:12.300535+0000","last_fullsized":"2024-01-24T12:44:12.300535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310395+0000","last_change":"2024-01-24T12:44:11.345146+0000","last_active":"2024-01-24T12:44:12.310395+0000","last_peered":"2024-01-24T12:44:12.310395+0000","last_clean":"2024-01-24T12:44:12.310395+0000","last_became_active":"2024-01-24T12:44:11.343454+0000","last_became_peered":"2024-01-24T12:44:11.343454+0000","last_unstale":"2024-01-24T12:44:12.310395+0000","last_undegraded":"2024-01-24T12:44:12.310395+0000","last_fullsized":"2024-01-24T12:44:12.310395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:45:06.184578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308221+0000","last_change":"2024-01-24T12:44:10.941647+0000","last_active":"2024-01-24T12:44:12.308221+0000","last_peered":"2024-01-24T12:44:12.308221+0000","last_clean":"2024-01-24T12:44:12.308221+0000","last_became_active":"2024-01-24T12:44:10.941177+0000","last_became_peered":"2024-01-24T12:44:10.941177+0000","last_unstale":"2024-01-24T12:44:12.308221+0000","last_undegraded":"2024-01-24T12:44:12.308221+0000","last_fullsized":"2024-01-24T12:44:12.308221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310690+0000","last_change":"2024-01-24T12:44:11.350856+0000","last_active":"2024-01-24T12:44:12.310690+0000","last_peered":"2024-01-24T12:44:12.310690+0000","last_clean":"2024-01-24T12:44:12.310690+0000","last_became_active":"2024-01-24T12:44:11.350244+0000","last_became_peered":"2024-01-24T12:44:11.350244+0000","last_unstale":"2024-01-24T12:44:12.310690+0000","last_undegraded":"2024-01-24T12:44:12.310690+0000","last_fullsized":"2024-01-24T12:44:12.310690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:31:04.636860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308635+0000","last_change":"2024-01-24T12:44:10.937540+0000","last_active":"2024-01-24T12:44:12.308635+0000","last_peered":"2024-01-24T12:44:12.308635+0000","last_clean":"2024-01-24T12:44:12.308635+0000","last_became_active":"2024-01-24T12:44:10.937246+0000","last_became_peered":"2024-01-24T12:44:10.937246+0000","last_unstale":"2024-01-24T12:44:12.308635+0000","last_undegraded":"2024-01-24T12:44:12.308635+0000","last_fullsized":"2024-01-24T12:44:12.308635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309138+0000","last_change":"2024-01-24T12:44:11.345714+0000","last_active":"2024-01-24T12:44:12.309138+0000","last_peered":"2024-01-24T12:44:12.309138+0000","last_clean":"2024-01-24T12:44:12.309138+0000","last_became_active":"2024-01-24T12:44:11.340127+0000","last_became_peered":"2024-01-24T12:44:11.340127+0000","last_unstale":"2024-01-24T12:44:12.309138+0000","last_undegraded":"2024-01-24T12:44:12.309138+0000","last_fullsized":"2024-01-24T12:44:12.309138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307978+0000","last_change":"2024-01-24T12:44:10.946919+0000","last_active":"2024-01-24T12:44:12.307978+0000","last_peered":"2024-01-24T12:44:12.307978+0000","last_clean":"2024-01-24T12:44:12.307978+0000","last_became_active":"2024-01-24T12:44:10.946607+0000","last_became_peered":"2024-01-24T12:44:10.946607+0000","last_unstale":"2024-01-24T12:44:12.307978+0000","last_undegraded":"2024-01-24T12:44:12.307978+0000","last_fullsized":"2024-01-24T12:44:12.307978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310112+0000","last_change":"2024-01-24T12:44:11.357380+0000","last_active":"2024-01-24T12:44:12.310112+0000","last_peered":"2024-01-24T12:44:12.310112+0000","last_clean":"2024-01-24T12:44:12.310112+0000","last_became_active":"2024-01-24T12:44:11.356720+0000","last_became_peered":"2024-01-24T12:44:11.356720+0000","last_unstale":"2024-01-24T12:44:12.310112+0000","last_undegraded":"2024-01-24T12:44:12.310112+0000","last_fullsized":"2024-01-24T12:44:12.310112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-24T12:44:11.307644+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:11.307644+0000","last_peered":"2024-01-24T12:44:11.307644+0000","last_clean":"2024-01-24T12:44:11.307644+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:11.307644+0000","last_undegraded":"2024-01-24T12:44:11.307644+0000","last_fullsized":"2024-01-24T12:44:11.307644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309210+0000","last_change":"2024-01-24T12:44:10.932841+0000","last_active":"2024-01-24T12:44:12.309210+0000","last_peered":"2024-01-24T12:44:12.309210+0000","last_clean":"2024-01-24T12:44:12.309210+0000","last_became_active":"2024-01-24T12:44:10.931862+0000","last_became_peered":"2024-01-24T12:44:10.931862+0000","last_unstale":"2024-01-24T12:44:12.309210+0000","last_undegraded":"2024-01-24T12:44:12.309210+0000","last_fullsized":"2024-01-24T12:44:12.309210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295950+0000","last_change":"2024-01-24T12:44:11.356544+0000","last_active":"2024-01-24T12:44:12.295950+0000","last_peered":"2024-01-24T12:44:12.295950+0000","last_clean":"2024-01-24T12:44:12.295950+0000","last_became_active":"2024-01-24T12:44:11.356289+0000","last_became_peered":"2024-01-24T12:44:11.356289+0000","last_unstale":"2024-01-24T12:44:12.295950+0000","last_undegraded":"2024-01-24T12:44:12.295950+0000","last_fullsized":"2024-01-24T12:44:12.295950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.954636+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.953755+0000","last_became_peered":"2024-01-24T12:44:10.953755+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306843+0000","last_change":"2024-01-24T12:44:11.322569+0000","last_active":"2024-01-24T12:44:12.306843+0000","last_peered":"2024-01-24T12:44:12.306843+0000","last_clean":"2024-01-24T12:44:12.306843+0000","last_became_active":"2024-01-24T12:44:11.322253+0000","last_became_peered":"2024-01-24T12:44:11.322253+0000","last_unstale":"2024-01-24T12:44:12.306843+0000","last_undegraded":"2024-01-24T12:44:12.306843+0000","last_fullsized":"2024-01-24T12:44:12.306843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308008+0000","last_change":"2024-01-24T12:44:10.941900+0000","last_active":"2024-01-24T12:44:12.308008+0000","last_peered":"2024-01-24T12:44:12.308008+0000","last_clean":"2024-01-24T12:44:12.308008+0000","last_became_active":"2024-01-24T12:44:10.941526+0000","last_became_peered":"2024-01-24T12:44:10.941526+0000","last_unstale":"2024-01-24T12:44:12.308008+0000","last_undegraded":"2024-01-24T12:44:12.308008+0000","last_fullsized":"2024-01-24T12:44:12.308008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307635+0000","last_change":"2024-01-24T12:44:11.306700+0000","last_active":"2024-01-24T12:44:12.307635+0000","last_peered":"2024-01-24T12:44:12.307635+0000","last_clean":"2024-01-24T12:44:12.307635+0000","last_became_active":"2024-01-24T12:44:11.306420+0000","last_became_peered":"2024-01-24T12:44:11.306420+0000","last_unstale":"2024-01-24T12:44:12.307635+0000","last_undegraded":"2024-01-24T12:44:12.307635+0000","last_fullsized":"2024-01-24T12:44:12.307635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308705+0000","last_change":"2024-01-24T12:44:10.939127+0000","last_active":"2024-01-24T12:44:12.308705+0000","last_peered":"2024-01-24T12:44:12.308705+0000","last_clean":"2024-01-24T12:44:12.308705+0000","last_became_active":"2024-01-24T12:44:10.936034+0000","last_became_peered":"2024-01-24T12:44:10.936034+0000","last_unstale":"2024-01-24T12:44:12.308705+0000","last_undegraded":"2024-01-24T12:44:12.308705+0000","last_fullsized":"2024-01-24T12:44:12.308705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300705+0000","last_change":"2024-01-24T12:44:11.326553+0000","last_active":"2024-01-24T12:44:12.300705+0000","last_peered":"2024-01-24T12:44:12.300705+0000","last_clean":"2024-01-24T12:44:12.300705+0000","last_became_active":"2024-01-24T12:44:11.322735+0000","last_became_peered":"2024-01-24T12:44:11.322735+0000","last_unstale":"2024-01-24T12:44:12.300705+0000","last_undegraded":"2024-01-24T12:44:12.300705+0000","last_fullsized":"2024-01-24T12:44:12.300705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308725+0000","last_change":"2024-01-24T12:44:10.932249+0000","last_active":"2024-01-24T12:44:12.308725+0000","last_peered":"2024-01-24T12:44:12.308725+0000","last_clean":"2024-01-24T12:44:12.308725+0000","last_became_active":"2024-01-24T12:44:10.931916+0000","last_became_peered":"2024-01-24T12:44:10.931916+0000","last_unstale":"2024-01-24T12:44:12.308725+0000","last_undegraded":"2024-01-24T12:44:12.308725+0000","last_fullsized":"2024-01-24T12:44:12.308725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308828+0000","last_change":"2024-01-24T12:44:11.341472+0000","last_active":"2024-01-24T12:44:12.308828+0000","last_peered":"2024-01-24T12:44:12.308828+0000","last_clean":"2024-01-24T12:44:12.308828+0000","last_became_active":"2024-01-24T12:44:11.339574+0000","last_became_peered":"2024-01-24T12:44:11.339574+0000","last_unstale":"2024-01-24T12:44:12.308828+0000","last_undegraded":"2024-01-24T12:44:12.308828+0000","last_fullsized":"2024-01-24T12:44:12.308828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310484+0000","last_change":"2024-01-24T12:44:10.954824+0000","last_active":"2024-01-24T12:44:12.310484+0000","last_peered":"2024-01-24T12:44:12.310484+0000","last_clean":"2024-01-24T12:44:12.310484+0000","last_became_active":"2024-01-24T12:44:10.953995+0000","last_became_peered":"2024-01-24T12:44:10.953995+0000","last_unstale":"2024-01-24T12:44:12.310484+0000","last_undegraded":"2024-01-24T12:44:12.310484+0000","last_fullsized":"2024-01-24T12:44:12.310484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:46.778299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308748+0000","last_change":"2024-01-24T12:44:11.306822+0000","last_active":"2024-01-24T12:44:12.308748+0000","last_peered":"2024-01-24T12:44:12.308748+0000","last_clean":"2024-01-24T12:44:12.308748+0000","last_became_active":"2024-01-24T12:44:11.306582+0000","last_became_peered":"2024-01-24T12:44:11.306582+0000","last_unstale":"2024-01-24T12:44:12.308748+0000","last_undegraded":"2024-01-24T12:44:12.308748+0000","last_fullsized":"2024-01-24T12:44:12.308748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308811+0000","last_change":"2024-01-24T12:44:10.945081+0000","last_active":"2024-01-24T12:44:12.308811+0000","last_peered":"2024-01-24T12:44:12.308811+0000","last_clean":"2024-01-24T12:44:12.308811+0000","last_became_active":"2024-01-24T12:44:10.944818+0000","last_became_peered":"2024-01-24T12:44:10.944818+0000","last_unstale":"2024-01-24T12:44:12.308811+0000","last_undegraded":"2024-01-24T12:44:12.308811+0000","last_fullsized":"2024-01-24T12:44:12.308811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296235+0000","last_change":"2024-01-24T12:44:11.338803+0000","last_active":"2024-01-24T12:44:12.296235+0000","last_peered":"2024-01-24T12:44:12.296235+0000","last_clean":"2024-01-24T12:44:12.296235+0000","last_became_active":"2024-01-24T12:44:11.338477+0000","last_became_peered":"2024-01-24T12:44:11.338477+0000","last_unstale":"2024-01-24T12:44:12.296235+0000","last_undegraded":"2024-01-24T12:44:12.296235+0000","last_fullsized":"2024-01-24T12:44:12.296235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298588+0000","last_change":"2024-01-24T12:44:10.939339+0000","last_active":"2024-01-24T12:44:12.298588+0000","last_peered":"2024-01-24T12:44:12.298588+0000","last_clean":"2024-01-24T12:44:12.298588+0000","last_became_active":"2024-01-24T12:44:10.938406+0000","last_became_peered":"2024-01-24T12:44:10.938406+0000","last_unstale":"2024-01-24T12:44:12.298588+0000","last_undegraded":"2024-01-24T12:44:12.298588+0000","last_fullsized":"2024-01-24T12:44:12.298588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307008+0000","last_change":"2024-01-24T12:44:11.302425+0000","last_active":"2024-01-24T12:44:12.307008+0000","last_peered":"2024-01-24T12:44:12.307008+0000","last_clean":"2024-01-24T12:44:12.307008+0000","last_became_active":"2024-01-24T12:44:11.302126+0000","last_became_peered":"2024-01-24T12:44:11.302126+0000","last_unstale":"2024-01-24T12:44:12.307008+0000","last_undegraded":"2024-01-24T12:44:12.307008+0000","last_fullsized":"2024-01-24T12:44:12.307008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308420+0000","last_change":"2024-01-24T12:44:10.954419+0000","last_active":"2024-01-24T12:44:12.308420+0000","last_peered":"2024-01-24T12:44:12.308420+0000","last_clean":"2024-01-24T12:44:12.308420+0000","last_became_active":"2024-01-24T12:44:10.953740+0000","last_became_peered":"2024-01-24T12:44:10.953740+0000","last_unstale":"2024-01-24T12:44:12.308420+0000","last_undegraded":"2024-01-24T12:44:12.308420+0000","last_fullsized":"2024-01-24T12:44:12.308420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:41.145058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299297+0000","last_change":"2024-01-24T12:44:11.323414+0000","last_active":"2024-01-24T12:44:12.299297+0000","last_peered":"2024-01-24T12:44:12.299297+0000","last_clean":"2024-01-24T12:44:12.299297+0000","last_became_active":"2024-01-24T12:44:11.321676+0000","last_became_peered":"2024-01-24T12:44:11.321676+0000","last_unstale":"2024-01-24T12:44:12.299297+0000","last_undegraded":"2024-01-24T12:44:12.299297+0000","last_fullsized":"2024-01-24T12:44:12.299297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:24.995947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308370+0000","last_change":"2024-01-24T12:44:10.932826+0000","last_active":"2024-01-24T12:44:12.308370+0000","last_peered":"2024-01-24T12:44:12.308370+0000","last_clean":"2024-01-24T12:44:12.308370+0000","last_became_active":"2024-01-24T12:44:10.931858+0000","last_became_peered":"2024-01-24T12:44:10.931858+0000","last_unstale":"2024-01-24T12:44:12.308370+0000","last_undegraded":"2024-01-24T12:44:12.308370+0000","last_fullsized":"2024-01-24T12:44:12.308370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296392+0000","last_change":"2024-01-24T12:44:11.305338+0000","last_active":"2024-01-24T12:44:12.296392+0000","last_peered":"2024-01-24T12:44:12.296392+0000","last_clean":"2024-01-24T12:44:12.296392+0000","last_became_active":"2024-01-24T12:44:11.305113+0000","last_became_peered":"2024-01-24T12:44:11.305113+0000","last_unstale":"2024-01-24T12:44:12.296392+0000","last_undegraded":"2024-01-24T12:44:12.296392+0000","last_fullsized":"2024-01-24T12:44:12.296392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308535+0000","last_change":"2024-01-24T12:44:10.943496+0000","last_active":"2024-01-24T12:44:12.308535+0000","last_peered":"2024-01-24T12:44:12.308535+0000","last_clean":"2024-01-24T12:44:12.308535+0000","last_became_active":"2024-01-24T12:44:10.943191+0000","last_became_peered":"2024-01-24T12:44:10.943191+0000","last_unstale":"2024-01-24T12:44:12.308535+0000","last_undegraded":"2024-01-24T12:44:12.308535+0000","last_fullsized":"2024-01-24T12:44:12.308535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296559+0000","last_change":"2024-01-24T12:44:11.306336+0000","last_active":"2024-01-24T12:44:12.296559+0000","last_peered":"2024-01-24T12:44:12.296559+0000","last_clean":"2024-01-24T12:44:12.296559+0000","last_became_active":"2024-01-24T12:44:11.306052+0000","last_became_peered":"2024-01-24T12:44:11.306052+0000","last_unstale":"2024-01-24T12:44:12.296559+0000","last_undegraded":"2024-01-24T12:44:12.296559+0000","last_fullsized":"2024-01-24T12:44:12.296559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310071+0000","last_change":"2024-01-24T12:44:10.959081+0000","last_active":"2024-01-24T12:44:12.310071+0000","last_peered":"2024-01-24T12:44:12.310071+0000","last_clean":"2024-01-24T12:44:12.310071+0000","last_became_active":"2024-01-24T12:44:10.956226+0000","last_became_peered":"2024-01-24T12:44:10.956226+0000","last_unstale":"2024-01-24T12:44:12.310071+0000","last_undegraded":"2024-01-24T12:44:12.310071+0000","last_fullsized":"2024-01-24T12:44:12.310071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:37.678733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297441+0000","last_change":"2024-01-24T12:44:11.335329+0000","last_active":"2024-01-24T12:44:12.297441+0000","last_peered":"2024-01-24T12:44:12.297441+0000","last_clean":"2024-01-24T12:44:12.297441+0000","last_became_active":"2024-01-24T12:44:11.334560+0000","last_became_peered":"2024-01-24T12:44:11.334560+0000","last_unstale":"2024-01-24T12:44:12.297441+0000","last_undegraded":"2024-01-24T12:44:12.297441+0000","last_fullsized":"2024-01-24T12:44:12.297441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309208+0000","last_change":"2024-01-24T12:44:11.357364+0000","last_active":"2024-01-24T12:44:12.309208+0000","last_peered":"2024-01-24T12:44:12.309208+0000","last_clean":"2024-01-24T12:44:12.309208+0000","last_became_active":"2024-01-24T12:44:11.354163+0000","last_became_peered":"2024-01-24T12:44:11.354163+0000","last_unstale":"2024-01-24T12:44:12.309208+0000","last_undegraded":"2024-01-24T12:44:12.309208+0000","last_fullsized":"2024-01-24T12:44:12.309208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309831+0000","last_change":"2024-01-24T12:44:10.954300+0000","last_active":"2024-01-24T12:44:12.309831+0000","last_peered":"2024-01-24T12:44:12.309831+0000","last_clean":"2024-01-24T12:44:12.309831+0000","last_became_active":"2024-01-24T12:44:10.953779+0000","last_became_peered":"2024-01-24T12:44:10.953779+0000","last_unstale":"2024-01-24T12:44:12.309831+0000","last_undegraded":"2024-01-24T12:44:12.309831+0000","last_fullsized":"2024-01-24T12:44:12.309831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:58.271375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308883+0000","last_change":"2024-01-24T12:44:11.343616+0000","last_active":"2024-01-24T12:44:12.308883+0000","last_peered":"2024-01-24T12:44:12.308883+0000","last_clean":"2024-01-24T12:44:12.308883+0000","last_became_active":"2024-01-24T12:44:11.342012+0000","last_became_peered":"2024-01-24T12:44:11.342012+0000","last_unstale":"2024-01-24T12:44:12.308883+0000","last_undegraded":"2024-01-24T12:44:12.308883+0000","last_fullsized":"2024-01-24T12:44:12.308883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310244+0000","last_change":"2024-01-24T12:44:10.956362+0000","last_active":"2024-01-24T12:44:12.310244+0000","last_peered":"2024-01-24T12:44:12.310244+0000","last_clean":"2024-01-24T12:44:12.310244+0000","last_became_active":"2024-01-24T12:44:10.955703+0000","last_became_peered":"2024-01-24T12:44:10.955703+0000","last_unstale":"2024-01-24T12:44:12.310244+0000","last_undegraded":"2024-01-24T12:44:12.310244+0000","last_fullsized":"2024-01-24T12:44:12.310244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:23.984897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307009+0000","last_change":"2024-01-24T12:44:11.356491+0000","last_active":"2024-01-24T12:44:12.307009+0000","last_peered":"2024-01-24T12:44:12.307009+0000","last_clean":"2024-01-24T12:44:12.307009+0000","last_became_active":"2024-01-24T12:44:11.356182+0000","last_became_peered":"2024-01-24T12:44:11.356182+0000","last_unstale":"2024-01-24T12:44:12.307009+0000","last_undegraded":"2024-01-24T12:44:12.307009+0000","last_fullsized":"2024-01-24T12:44:12.307009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296190+0000","last_change":"2024-01-24T12:44:10.934690+0000","last_active":"2024-01-24T12:44:12.296190+0000","last_peered":"2024-01-24T12:44:12.296190+0000","last_clean":"2024-01-24T12:44:12.296190+0000","last_became_active":"2024-01-24T12:44:10.934221+0000","last_became_peered":"2024-01-24T12:44:10.934221+0000","last_unstale":"2024-01-24T12:44:12.296190+0000","last_undegraded":"2024-01-24T12:44:12.296190+0000","last_fullsized":"2024-01-24T12:44:12.296190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296123+0000","last_change":"2024-01-24T12:44:11.333832+0000","last_active":"2024-01-24T12:44:12.296123+0000","last_peered":"2024-01-24T12:44:12.296123+0000","last_clean":"2024-01-24T12:44:12.296123+0000","last_became_active":"2024-01-24T12:44:11.333545+0000","last_became_peered":"2024-01-24T12:44:11.333545+0000","last_unstale":"2024-01-24T12:44:12.296123+0000","last_undegraded":"2024-01-24T12:44:12.296123+0000","last_fullsized":"2024-01-24T12:44:12.296123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307335+0000","last_change":"2024-01-24T12:44:10.950192+0000","last_active":"2024-01-24T12:44:12.307335+0000","last_peered":"2024-01-24T12:44:12.307335+0000","last_clean":"2024-01-24T12:44:12.307335+0000","last_became_active":"2024-01-24T12:44:10.949914+0000","last_became_peered":"2024-01-24T12:44:10.949914+0000","last_unstale":"2024-01-24T12:44:12.307335+0000","last_undegraded":"2024-01-24T12:44:12.307335+0000","last_fullsized":"2024-01-24T12:44:12.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:19.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:19.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 Processor -- start 2024-01-24T12:44:19.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 -- start start 2024-01-24T12:44:19.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3858071160 0x7f38580b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f38580b42d0 0x7f38580b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f385814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580b5140 con 0x7f3858071160 2024-01-24T12:44:19.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580b3c40 con 0x7f38580b42d0 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ecc2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b4720 con 0x7f38581429f0 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3858071160 0x7f38580b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3858071160 0x7f38580b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59098/0 (socket says 172.21.15.27:59098) 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 -- 172.21.15.27:0/446752516 learned_addr learned my addr 172.21.15.27:0/446752516 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f3857fff640 1 --2- 172.21.15.27:0/446752516 >> v2:172.21.15.124:3300/0 conn(0x7f38580b42d0 0x7f38580b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385d25f640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f385814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 -- 172.21.15.27:0/446752516 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 msgr2=0x7f385814bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f385814bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 -- 172.21.15.27:0/446752516 >> v2:172.21.15.124:3300/0 conn(0x7f38580b42d0 msgr2=0x7f38580b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 --2- 172.21.15.27:0/446752516 >> v2:172.21.15.124:3300/0 conn(0x7f38580b42d0 0x7f38580b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.563+0000 7f385ca5e640 1 -- 172.21.15.27:0/446752516 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580b9f60 con 0x7f3858071160 2024-01-24T12:44:19.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ca5e640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3858071160 0x7f38580b9900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38580bbca0 tx=0x7f384001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502af0b7259892ba server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f38577fe640 1 -- 172.21.15.27:0/446752516 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400a5840 con 0x7f3858071160 2024-01-24T12:44:19.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f38577fe640 1 -- 172.21.15.27:0/446752516 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38400a59a0 con 0x7f3858071160 2024-01-24T12:44:19.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f38577fe640 1 -- 172.21.15.27:0/446752516 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400a5d30 con 0x7f3858071160 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- 172.21.15.27:0/446752516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3858071160 msgr2=0x7f38580b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3858071160 0x7f38580b9900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38580bbca0 tx=0x7f384001c9a0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- 172.21.15.27:0/446752516 shutdown_connections 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- 172.21.15.27:0/446752516 >> v2:172.21.15.124:3300/0 conn(0x7f38580b42d0 0x7f38580b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f385814bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- 172.21.15.27:0/446752516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3858071160 0x7f38580b9900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- 172.21.15.27:0/446752516 >> 172.21.15.27:0/446752516 conn(0x7f38580be150 msgr2=0x7f38580be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- 172.21.15.27:0/446752516 shutdown_connections 2024-01-24T12:44:19.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- 172.21.15.27:0/446752516 wait complete. 2024-01-24T12:44:19.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 Processor -- start 2024-01-24T12:44:19.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- start start 2024-01-24T12:44:19.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 0x7f385814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f3858144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385814be10 con 0x7f38580b42d0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38581444b0 con 0x7f3858071160 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ecc2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b53b0 con 0x7f38581429f0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59110/0 (socket says 172.21.15.27:59110) 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 -- 172.21.15.27:0/81639631 learned_addr learned my addr 172.21.15.27:0/81639631 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385ca5e640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 0x7f385814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 -- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 msgr2=0x7f3858144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f385d25f640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f3858144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f3858144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 -- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 msgr2=0x7f385814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.567+0000 7f3857fff640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 0x7f385814b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f3857fff640 1 -- 172.21.15.27:0/81639631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840009b30 con 0x7f38580b42d0 2024-01-24T12:44:19.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ca5e640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 0x7f385814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385d25f640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f3858144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f3857fff640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f384800d800 tx=0x7f384800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480096a0 con 0x7f38580b42d0 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848009800 con 0x7f38580b42d0 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580b5650 con 0x7f38580b42d0 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848009b70 con 0x7f38580b42d0 2024-01-24T12:44:19.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580b7250 con 0x7f38580b42d0 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385804e000 con 0x7f38580b42d0 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3848009cd0 con 0x7f38580b42d0 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38480838d0 con 0x7f38580b42d0 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ca5e640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.571+0000 7f385ca5e640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 0x7f383c067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38400ae000 tx=0x7f38400a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.575+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3848051280 con 0x7f38580b42d0 2024-01-24T12:44:19.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.727+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38580b93e0 con 0x7f383c065a60 2024-01-24T12:44:19.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.747+0000 7f38557fa640 1 -- 172.21.15.27:0/81639631 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f38400091d0 con 0x7f383c065a60 2024-01-24T12:44:19.753 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:19.755 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 msgr2=0x7f383c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 0x7f383c067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38400ae000 tx=0x7f38400a7070 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 msgr2=0x7f3858144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f384800d800 tx=0x7f384800dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 shutdown_connections 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38581429f0 0x7f3858144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38580b42d0 0x7f3858144900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 --2- 172.21.15.27:0/81639631 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3858071160 0x7f385814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 >> 172.21.15.27:0/81639631 conn(0x7f38580be150 msgr2=0x7f38580bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:19.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 shutdown_connections 2024-01-24T12:44:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.755+0000 7f385ecc2640 1 -- 172.21.15.27:0/81639631 wait complete. 2024-01-24T12:44:19.773 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-24T12:44:19.623004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.330409"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310364+0000","last_change":"2024-01-24T12:44:11.346047+0000","last_active":"2024-01-24T12:44:12.310364+0000","last_peered":"2024-01-24T12:44:12.310364+0000","last_clean":"2024-01-24T12:44:12.310364+0000","last_became_active":"2024-01-24T12:44:11.345291+0000","last_became_peered":"2024-01-24T12:44:11.345291+0000","last_unstale":"2024-01-24T12:44:12.310364+0000","last_undegraded":"2024-01-24T12:44:12.310364+0000","last_fullsized":"2024-01-24T12:44:12.310364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308731+0000","last_change":"2024-01-24T12:44:11.311127+0000","last_active":"2024-01-24T12:44:12.308731+0000","last_peered":"2024-01-24T12:44:12.308731+0000","last_clean":"2024-01-24T12:44:12.308731+0000","last_became_active":"2024-01-24T12:44:11.310860+0000","last_became_peered":"2024-01-24T12:44:11.310860+0000","last_unstale":"2024-01-24T12:44:12.308731+0000","last_undegraded":"2024-01-24T12:44:12.308731+0000","last_fullsized":"2024-01-24T12:44:12.308731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306766+0000","last_change":"2024-01-24T12:44:11.304106+0000","last_active":"2024-01-24T12:44:12.306766+0000","last_peered":"2024-01-24T12:44:12.306766+0000","last_clean":"2024-01-24T12:44:12.306766+0000","last_became_active":"2024-01-24T12:44:11.303766+0000","last_became_peered":"2024-01-24T12:44:11.303766+0000","last_unstale":"2024-01-24T12:44:12.306766+0000","last_undegraded":"2024-01-24T12:44:12.306766+0000","last_fullsized":"2024-01-24T12:44:12.306766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308433+0000","last_change":"2024-01-24T12:44:11.344843+0000","last_active":"2024-01-24T12:44:12.308433+0000","last_peered":"2024-01-24T12:44:12.308433+0000","last_clean":"2024-01-24T12:44:12.308433+0000","last_became_active":"2024-01-24T12:44:11.342895+0000","last_became_peered":"2024-01-24T12:44:11.342895+0000","last_unstale":"2024-01-24T12:44:12.308433+0000","last_undegraded":"2024-01-24T12:44:12.308433+0000","last_fullsized":"2024-01-24T12:44:12.308433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309684+0000","last_change":"2024-01-24T12:44:11.350959+0000","last_active":"2024-01-24T12:44:12.309684+0000","last_peered":"2024-01-24T12:44:12.309684+0000","last_clean":"2024-01-24T12:44:12.309684+0000","last_became_active":"2024-01-24T12:44:11.350348+0000","last_became_peered":"2024-01-24T12:44:11.350348+0000","last_unstale":"2024-01-24T12:44:12.309684+0000","last_undegraded":"2024-01-24T12:44:12.309684+0000","last_fullsized":"2024-01-24T12:44:12.309684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308183+0000","last_change":"2024-01-24T12:44:11.356890+0000","last_active":"2024-01-24T12:44:12.308183+0000","last_peered":"2024-01-24T12:44:12.308183+0000","last_clean":"2024-01-24T12:44:12.308183+0000","last_became_active":"2024-01-24T12:44:11.356294+0000","last_became_peered":"2024-01-24T12:44:11.356294+0000","last_unstale":"2024-01-24T12:44:12.308183+0000","last_undegraded":"2024-01-24T12:44:12.308183+0000","last_fullsized":"2024-01-24T12:44:12.308183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308450+0000","last_change":"2024-01-24T12:44:11.338748+0000","last_active":"2024-01-24T12:44:12.308450+0000","last_peered":"2024-01-24T12:44:12.308450+0000","last_clean":"2024-01-24T12:44:12.308450+0000","last_became_active":"2024-01-24T12:44:11.337933+0000","last_became_peered":"2024-01-24T12:44:11.337933+0000","last_unstale":"2024-01-24T12:44:12.308450+0000","last_undegraded":"2024-01-24T12:44:12.308450+0000","last_fullsized":"2024-01-24T12:44:12.308450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295959+0000","last_change":"2024-01-24T12:44:11.356535+0000","last_active":"2024-01-24T12:44:12.295959+0000","last_peered":"2024-01-24T12:44:12.295959+0000","last_clean":"2024-01-24T12:44:12.295959+0000","last_became_active":"2024-01-24T12:44:11.356329+0000","last_became_peered":"2024-01-24T12:44:11.356329+0000","last_unstale":"2024-01-24T12:44:12.295959+0000","last_undegraded":"2024-01-24T12:44:12.295959+0000","last_fullsized":"2024-01-24T12:44:12.295959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310566+0000","last_change":"2024-01-24T12:44:11.358761+0000","last_active":"2024-01-24T12:44:12.310566+0000","last_peered":"2024-01-24T12:44:12.310566+0000","last_clean":"2024-01-24T12:44:12.310566+0000","last_became_active":"2024-01-24T12:44:11.358193+0000","last_became_peered":"2024-01-24T12:44:11.358193+0000","last_unstale":"2024-01-24T12:44:12.310566+0000","last_undegraded":"2024-01-24T12:44:12.310566+0000","last_fullsized":"2024-01-24T12:44:12.310566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298433+0000","last_change":"2024-01-24T12:44:11.344182+0000","last_active":"2024-01-24T12:44:12.298433+0000","last_peered":"2024-01-24T12:44:12.298433+0000","last_clean":"2024-01-24T12:44:12.298433+0000","last_became_active":"2024-01-24T12:44:11.343506+0000","last_became_peered":"2024-01-24T12:44:11.343506+0000","last_unstale":"2024-01-24T12:44:12.298433+0000","last_undegraded":"2024-01-24T12:44:12.298433+0000","last_fullsized":"2024-01-24T12:44:12.298433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297856+0000","last_change":"2024-01-24T12:44:11.356600+0000","last_active":"2024-01-24T12:44:12.297856+0000","last_peered":"2024-01-24T12:44:12.297856+0000","last_clean":"2024-01-24T12:44:12.297856+0000","last_became_active":"2024-01-24T12:44:11.355969+0000","last_became_peered":"2024-01-24T12:44:11.355969+0000","last_unstale":"2024-01-24T12:44:12.297856+0000","last_undegraded":"2024-01-24T12:44:12.297856+0000","last_fullsized":"2024-01-24T12:44:12.297856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300489+0000","last_change":"2024-01-24T12:44:11.323993+0000","last_active":"2024-01-24T12:44:12.300489+0000","last_peered":"2024-01-24T12:44:12.300489+0000","last_clean":"2024-01-24T12:44:12.300489+0000","last_became_active":"2024-01-24T12:44:11.323228+0000","last_became_peered":"2024-01-24T12:44:11.323228+0000","last_unstale":"2024-01-24T12:44:12.300489+0000","last_undegraded":"2024-01-24T12:44:12.300489+0000","last_fullsized":"2024-01-24T12:44:12.300489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296421+0000","last_change":"2024-01-24T12:44:11.333852+0000","last_active":"2024-01-24T12:44:12.296421+0000","last_peered":"2024-01-24T12:44:12.296421+0000","last_clean":"2024-01-24T12:44:12.296421+0000","last_became_active":"2024-01-24T12:44:11.333515+0000","last_became_peered":"2024-01-24T12:44:11.333515+0000","last_unstale":"2024-01-24T12:44:12.296421+0000","last_undegraded":"2024-01-24T12:44:12.296421+0000","last_fullsized":"2024-01-24T12:44:12.296421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306748+0000","last_change":"2024-01-24T12:44:11.303301+0000","last_active":"2024-01-24T12:44:12.306748+0000","last_peered":"2024-01-24T12:44:12.306748+0000","last_clean":"2024-01-24T12:44:12.306748+0000","last_became_active":"2024-01-24T12:44:11.303019+0000","last_became_peered":"2024-01-24T12:44:11.303019+0000","last_unstale":"2024-01-24T12:44:12.306748+0000","last_undegraded":"2024-01-24T12:44:12.306748+0000","last_fullsized":"2024-01-24T12:44:12.306748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:27:22.445760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307701+0000","last_change":"2024-01-24T12:44:11.335600+0000","last_active":"2024-01-24T12:44:12.307701+0000","last_peered":"2024-01-24T12:44:12.307701+0000","last_clean":"2024-01-24T12:44:12.307701+0000","last_became_active":"2024-01-24T12:44:11.335242+0000","last_became_peered":"2024-01-24T12:44:11.335242+0000","last_unstale":"2024-01-24T12:44:12.307701+0000","last_undegraded":"2024-01-24T12:44:12.307701+0000","last_fullsized":"2024-01-24T12:44:12.307701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309464+0000","last_change":"2024-01-24T12:44:11.355761+0000","last_active":"2024-01-24T12:44:12.309464+0000","last_peered":"2024-01-24T12:44:12.309464+0000","last_clean":"2024-01-24T12:44:12.309464+0000","last_became_active":"2024-01-24T12:44:11.355005+0000","last_became_peered":"2024-01-24T12:44:11.355005+0000","last_unstale":"2024-01-24T12:44:12.309464+0000","last_undegraded":"2024-01-24T12:44:12.309464+0000","last_fullsized":"2024-01-24T12:44:12.309464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309115+0000","last_change":"2024-01-24T12:44:11.342686+0000","last_active":"2024-01-24T12:44:12.309115+0000","last_peered":"2024-01-24T12:44:12.309115+0000","last_clean":"2024-01-24T12:44:12.309115+0000","last_became_active":"2024-01-24T12:44:11.341936+0000","last_became_peered":"2024-01-24T12:44:11.341936+0000","last_unstale":"2024-01-24T12:44:12.309115+0000","last_undegraded":"2024-01-24T12:44:12.309115+0000","last_fullsized":"2024-01-24T12:44:12.309115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307772+0000","last_change":"2024-01-24T12:44:11.333755+0000","last_active":"2024-01-24T12:44:12.307772+0000","last_peered":"2024-01-24T12:44:12.307772+0000","last_clean":"2024-01-24T12:44:12.307772+0000","last_became_active":"2024-01-24T12:44:11.333446+0000","last_became_peered":"2024-01-24T12:44:11.333446+0000","last_unstale":"2024-01-24T12:44:12.307772+0000","last_undegraded":"2024-01-24T12:44:12.307772+0000","last_fullsized":"2024-01-24T12:44:12.307772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310343+0000","last_change":"2024-01-24T12:44:11.351739+0000","last_active":"2024-01-24T12:44:12.310343+0000","last_peered":"2024-01-24T12:44:12.310343+0000","last_clean":"2024-01-24T12:44:12.310343+0000","last_became_active":"2024-01-24T12:44:11.350438+0000","last_became_peered":"2024-01-24T12:44:11.350438+0000","last_unstale":"2024-01-24T12:44:12.310343+0000","last_undegraded":"2024-01-24T12:44:12.310343+0000","last_fullsized":"2024-01-24T12:44:12.310343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297822+0000","last_change":"2024-01-24T12:44:11.328405+0000","last_active":"2024-01-24T12:44:12.297822+0000","last_peered":"2024-01-24T12:44:12.297822+0000","last_clean":"2024-01-24T12:44:12.297822+0000","last_became_active":"2024-01-24T12:44:11.327290+0000","last_became_peered":"2024-01-24T12:44:11.327290+0000","last_unstale":"2024-01-24T12:44:12.297822+0000","last_undegraded":"2024-01-24T12:44:12.297822+0000","last_fullsized":"2024-01-24T12:44:12.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307157+0000","last_change":"2024-01-24T12:44:11.338647+0000","last_active":"2024-01-24T12:44:12.307157+0000","last_peered":"2024-01-24T12:44:12.307157+0000","last_clean":"2024-01-24T12:44:12.307157+0000","last_became_active":"2024-01-24T12:44:11.338384+0000","last_became_peered":"2024-01-24T12:44:11.338384+0000","last_unstale":"2024-01-24T12:44:12.307157+0000","last_undegraded":"2024-01-24T12:44:12.307157+0000","last_fullsized":"2024-01-24T12:44:12.307157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308232+0000","last_change":"2024-01-24T12:44:11.355653+0000","last_active":"2024-01-24T12:44:12.308232+0000","last_peered":"2024-01-24T12:44:12.308232+0000","last_clean":"2024-01-24T12:44:12.308232+0000","last_became_active":"2024-01-24T12:44:11.354823+0000","last_became_peered":"2024-01-24T12:44:11.354823+0000","last_unstale":"2024-01-24T12:44:12.308232+0000","last_undegraded":"2024-01-24T12:44:12.308232+0000","last_fullsized":"2024-01-24T12:44:12.308232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296174+0000","last_change":"2024-01-24T12:44:11.323202+0000","last_active":"2024-01-24T12:44:12.296174+0000","last_peered":"2024-01-24T12:44:12.296174+0000","last_clean":"2024-01-24T12:44:12.296174+0000","last_became_active":"2024-01-24T12:44:11.322874+0000","last_became_peered":"2024-01-24T12:44:11.322874+0000","last_unstale":"2024-01-24T12:44:12.296174+0000","last_undegraded":"2024-01-24T12:44:12.296174+0000","last_fullsized":"2024-01-24T12:44:12.296174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308180+0000","last_change":"2024-01-24T12:44:11.354498+0000","last_active":"2024-01-24T12:44:12.308180+0000","last_peered":"2024-01-24T12:44:12.308180+0000","last_clean":"2024-01-24T12:44:12.308180+0000","last_became_active":"2024-01-24T12:44:11.353885+0000","last_became_peered":"2024-01-24T12:44:11.353885+0000","last_unstale":"2024-01-24T12:44:12.308180+0000","last_undegraded":"2024-01-24T12:44:12.308180+0000","last_fullsized":"2024-01-24T12:44:12.308180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296059+0000","last_change":"2024-01-24T12:44:11.326023+0000","last_active":"2024-01-24T12:44:12.296059+0000","last_peered":"2024-01-24T12:44:12.296059+0000","last_clean":"2024-01-24T12:44:12.296059+0000","last_became_active":"2024-01-24T12:44:11.325817+0000","last_became_peered":"2024-01-24T12:44:11.325817+0000","last_unstale":"2024-01-24T12:44:12.296059+0000","last_undegraded":"2024-01-24T12:44:12.296059+0000","last_fullsized":"2024-01-24T12:44:12.296059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298514+0000","last_change":"2024-01-24T12:44:11.340890+0000","last_active":"2024-01-24T12:44:12.298514+0000","last_peered":"2024-01-24T12:44:12.298514+0000","last_clean":"2024-01-24T12:44:12.298514+0000","last_became_active":"2024-01-24T12:44:11.340032+0000","last_became_peered":"2024-01-24T12:44:11.340032+0000","last_unstale":"2024-01-24T12:44:12.298514+0000","last_undegraded":"2024-01-24T12:44:12.298514+0000","last_fullsized":"2024-01-24T12:44:12.298514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308552+0000","last_change":"2024-01-24T12:44:11.304881+0000","last_active":"2024-01-24T12:44:12.308552+0000","last_peered":"2024-01-24T12:44:12.308552+0000","last_clean":"2024-01-24T12:44:12.308552+0000","last_became_active":"2024-01-24T12:44:11.304584+0000","last_became_peered":"2024-01-24T12:44:11.304584+0000","last_unstale":"2024-01-24T12:44:12.308552+0000","last_undegraded":"2024-01-24T12:44:12.308552+0000","last_fullsized":"2024-01-24T12:44:12.308552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296302+0000","last_change":"2024-01-24T12:44:11.325073+0000","last_active":"2024-01-24T12:44:12.296302+0000","last_peered":"2024-01-24T12:44:12.296302+0000","last_clean":"2024-01-24T12:44:12.296302+0000","last_became_active":"2024-01-24T12:44:11.324807+0000","last_became_peered":"2024-01-24T12:44:11.324807+0000","last_unstale":"2024-01-24T12:44:12.296302+0000","last_undegraded":"2024-01-24T12:44:12.296302+0000","last_fullsized":"2024-01-24T12:44:12.296302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307195+0000","last_change":"2024-01-24T12:44:11.303436+0000","last_active":"2024-01-24T12:44:12.307195+0000","last_peered":"2024-01-24T12:44:12.307195+0000","last_clean":"2024-01-24T12:44:12.307195+0000","last_became_active":"2024-01-24T12:44:11.303191+0000","last_became_peered":"2024-01-24T12:44:11.303191+0000","last_unstale":"2024-01-24T12:44:12.307195+0000","last_undegraded":"2024-01-24T12:44:12.307195+0000","last_fullsized":"2024-01-24T12:44:12.307195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308464+0000","last_change":"2024-01-24T12:44:11.355739+0000","last_active":"2024-01-24T12:44:12.308464+0000","last_peered":"2024-01-24T12:44:12.308464+0000","last_clean":"2024-01-24T12:44:12.308464+0000","last_became_active":"2024-01-24T12:44:11.354956+0000","last_became_peered":"2024-01-24T12:44:11.354956+0000","last_unstale":"2024-01-24T12:44:12.308464+0000","last_undegraded":"2024-01-24T12:44:12.308464+0000","last_fullsized":"2024-01-24T12:44:12.308464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307893+0000","last_change":"2024-01-24T12:44:11.341356+0000","last_active":"2024-01-24T12:44:12.307893+0000","last_peered":"2024-01-24T12:44:12.307893+0000","last_clean":"2024-01-24T12:44:12.307893+0000","last_became_active":"2024-01-24T12:44:11.341002+0000","last_became_peered":"2024-01-24T12:44:11.341002+0000","last_unstale":"2024-01-24T12:44:12.307893+0000","last_undegraded":"2024-01-24T12:44:12.307893+0000","last_fullsized":"2024-01-24T12:44:12.307893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297329+0000","last_change":"2024-01-24T12:44:11.318461+0000","last_active":"2024-01-24T12:44:12.297329+0000","last_peered":"2024-01-24T12:44:12.297329+0000","last_clean":"2024-01-24T12:44:12.297329+0000","last_became_active":"2024-01-24T12:44:11.317738+0000","last_became_peered":"2024-01-24T12:44:11.317738+0000","last_unstale":"2024-01-24T12:44:12.297329+0000","last_undegraded":"2024-01-24T12:44:12.297329+0000","last_fullsized":"2024-01-24T12:44:12.297329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299592+0000","last_change":"2024-01-24T12:44:11.324214+0000","last_active":"2024-01-24T12:44:12.299592+0000","last_peered":"2024-01-24T12:44:12.299592+0000","last_clean":"2024-01-24T12:44:12.299592+0000","last_became_active":"2024-01-24T12:44:11.323445+0000","last_became_peered":"2024-01-24T12:44:11.323445+0000","last_unstale":"2024-01-24T12:44:12.299592+0000","last_undegraded":"2024-01-24T12:44:12.299592+0000","last_fullsized":"2024-01-24T12:44:12.299592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296576+0000","last_change":"2024-01-24T12:44:10.955244+0000","last_active":"2024-01-24T12:44:12.296576+0000","last_peered":"2024-01-24T12:44:12.296576+0000","last_clean":"2024-01-24T12:44:12.296576+0000","last_became_active":"2024-01-24T12:44:10.954900+0000","last_became_peered":"2024-01-24T12:44:10.954900+0000","last_unstale":"2024-01-24T12:44:12.296576+0000","last_undegraded":"2024-01-24T12:44:12.296576+0000","last_fullsized":"2024-01-24T12:44:12.296576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307282+0000","last_change":"2024-01-24T12:44:11.322525+0000","last_active":"2024-01-24T12:44:12.307282+0000","last_peered":"2024-01-24T12:44:12.307282+0000","last_clean":"2024-01-24T12:44:12.307282+0000","last_became_active":"2024-01-24T12:44:11.322196+0000","last_became_peered":"2024-01-24T12:44:11.322196+0000","last_unstale":"2024-01-24T12:44:12.307282+0000","last_undegraded":"2024-01-24T12:44:12.307282+0000","last_fullsized":"2024-01-24T12:44:12.307282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297693+0000","last_change":"2024-01-24T12:44:10.938016+0000","last_active":"2024-01-24T12:44:12.297693+0000","last_peered":"2024-01-24T12:44:12.297693+0000","last_clean":"2024-01-24T12:44:12.297693+0000","last_became_active":"2024-01-24T12:44:10.937051+0000","last_became_peered":"2024-01-24T12:44:10.937051+0000","last_unstale":"2024-01-24T12:44:12.297693+0000","last_undegraded":"2024-01-24T12:44:12.297693+0000","last_fullsized":"2024-01-24T12:44:12.297693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296065+0000","last_change":"2024-01-24T12:44:10.944973+0000","last_active":"2024-01-24T12:44:12.296065+0000","last_peered":"2024-01-24T12:44:12.296065+0000","last_clean":"2024-01-24T12:44:12.296065+0000","last_became_active":"2024-01-24T12:44:10.944391+0000","last_became_peered":"2024-01-24T12:44:10.944391+0000","last_unstale":"2024-01-24T12:44:12.296065+0000","last_undegraded":"2024-01-24T12:44:12.296065+0000","last_fullsized":"2024-01-24T12:44:12.296065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296241+0000","last_change":"2024-01-24T12:44:11.306739+0000","last_active":"2024-01-24T12:44:12.296241+0000","last_peered":"2024-01-24T12:44:12.296241+0000","last_clean":"2024-01-24T12:44:12.296241+0000","last_became_active":"2024-01-24T12:44:11.306515+0000","last_became_peered":"2024-01-24T12:44:11.306515+0000","last_unstale":"2024-01-24T12:44:12.296241+0000","last_undegraded":"2024-01-24T12:44:12.296241+0000","last_fullsized":"2024-01-24T12:44:12.296241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308408+0000","last_change":"2024-01-24T12:44:10.937679+0000","last_active":"2024-01-24T12:44:12.308408+0000","last_peered":"2024-01-24T12:44:12.308408+0000","last_clean":"2024-01-24T12:44:12.308408+0000","last_became_active":"2024-01-24T12:44:10.936808+0000","last_became_peered":"2024-01-24T12:44:10.936808+0000","last_unstale":"2024-01-24T12:44:12.308408+0000","last_undegraded":"2024-01-24T12:44:12.308408+0000","last_fullsized":"2024-01-24T12:44:12.308408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307614+0000","last_change":"2024-01-24T12:44:11.305203+0000","last_active":"2024-01-24T12:44:12.307614+0000","last_peered":"2024-01-24T12:44:12.307614+0000","last_clean":"2024-01-24T12:44:12.307614+0000","last_became_active":"2024-01-24T12:44:11.304919+0000","last_became_peered":"2024-01-24T12:44:11.304919+0000","last_unstale":"2024-01-24T12:44:12.307614+0000","last_undegraded":"2024-01-24T12:44:12.307614+0000","last_fullsized":"2024-01-24T12:44:12.307614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298446+0000","last_change":"2024-01-24T12:44:10.949242+0000","last_active":"2024-01-24T12:44:12.298446+0000","last_peered":"2024-01-24T12:44:12.298446+0000","last_clean":"2024-01-24T12:44:12.298446+0000","last_became_active":"2024-01-24T12:44:10.948044+0000","last_became_peered":"2024-01-24T12:44:10.948044+0000","last_unstale":"2024-01-24T12:44:12.298446+0000","last_undegraded":"2024-01-24T12:44:12.298446+0000","last_fullsized":"2024-01-24T12:44:12.298446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308948+0000","last_change":"2024-01-24T12:44:11.346554+0000","last_active":"2024-01-24T12:44:12.308948+0000","last_peered":"2024-01-24T12:44:12.308948+0000","last_clean":"2024-01-24T12:44:12.308948+0000","last_became_active":"2024-01-24T12:44:11.345775+0000","last_became_peered":"2024-01-24T12:44:11.345775+0000","last_unstale":"2024-01-24T12:44:12.308948+0000","last_undegraded":"2024-01-24T12:44:12.308948+0000","last_fullsized":"2024-01-24T12:44:12.308948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309141+0000","last_change":"2024-01-24T12:44:10.944636+0000","last_active":"2024-01-24T12:44:12.309141+0000","last_peered":"2024-01-24T12:44:12.309141+0000","last_clean":"2024-01-24T12:44:12.309141+0000","last_became_active":"2024-01-24T12:44:10.943901+0000","last_became_peered":"2024-01-24T12:44:10.943901+0000","last_unstale":"2024-01-24T12:44:12.309141+0000","last_undegraded":"2024-01-24T12:44:12.309141+0000","last_fullsized":"2024-01-24T12:44:12.309141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307177+0000","last_change":"2024-01-24T12:44:11.343815+0000","last_active":"2024-01-24T12:44:12.307177+0000","last_peered":"2024-01-24T12:44:12.307177+0000","last_clean":"2024-01-24T12:44:12.307177+0000","last_became_active":"2024-01-24T12:44:11.343536+0000","last_became_peered":"2024-01-24T12:44:11.343536+0000","last_unstale":"2024-01-24T12:44:12.307177+0000","last_undegraded":"2024-01-24T12:44:12.307177+0000","last_fullsized":"2024-01-24T12:44:12.307177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.948117+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.947825+0000","last_became_peered":"2024-01-24T12:44:10.947825+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300676+0000","last_change":"2024-01-24T12:44:11.340824+0000","last_active":"2024-01-24T12:44:12.300676+0000","last_peered":"2024-01-24T12:44:12.300676+0000","last_clean":"2024-01-24T12:44:12.300676+0000","last_became_active":"2024-01-24T12:44:11.340194+0000","last_became_peered":"2024-01-24T12:44:11.340194+0000","last_unstale":"2024-01-24T12:44:12.300676+0000","last_undegraded":"2024-01-24T12:44:12.300676+0000","last_fullsized":"2024-01-24T12:44:12.300676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297929+0000","last_change":"2024-01-24T12:44:10.932460+0000","last_active":"2024-01-24T12:44:12.297929+0000","last_peered":"2024-01-24T12:44:12.297929+0000","last_clean":"2024-01-24T12:44:12.297929+0000","last_became_active":"2024-01-24T12:44:10.931678+0000","last_became_peered":"2024-01-24T12:44:10.931678+0000","last_unstale":"2024-01-24T12:44:12.297929+0000","last_undegraded":"2024-01-24T12:44:12.297929+0000","last_fullsized":"2024-01-24T12:44:12.297929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310013+0000","last_change":"2024-01-24T12:44:11.338493+0000","last_active":"2024-01-24T12:44:12.310013+0000","last_peered":"2024-01-24T12:44:12.310013+0000","last_clean":"2024-01-24T12:44:12.310013+0000","last_became_active":"2024-01-24T12:44:11.337805+0000","last_became_peered":"2024-01-24T12:44:11.337805+0000","last_unstale":"2024-01-24T12:44:12.310013+0000","last_undegraded":"2024-01-24T12:44:12.310013+0000","last_fullsized":"2024-01-24T12:44:12.310013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307465+0000","last_change":"2024-01-24T12:44:10.948122+0000","last_active":"2024-01-24T12:44:12.307465+0000","last_peered":"2024-01-24T12:44:12.307465+0000","last_clean":"2024-01-24T12:44:12.307465+0000","last_became_active":"2024-01-24T12:44:10.947868+0000","last_became_peered":"2024-01-24T12:44:10.947868+0000","last_unstale":"2024-01-24T12:44:12.307465+0000","last_undegraded":"2024-01-24T12:44:12.307465+0000","last_fullsized":"2024-01-24T12:44:12.307465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306691+0000","last_change":"2024-01-24T12:44:11.338719+0000","last_active":"2024-01-24T12:44:12.306691+0000","last_peered":"2024-01-24T12:44:12.306691+0000","last_clean":"2024-01-24T12:44:12.306691+0000","last_became_active":"2024-01-24T12:44:11.338420+0000","last_became_peered":"2024-01-24T12:44:11.338420+0000","last_unstale":"2024-01-24T12:44:12.306691+0000","last_undegraded":"2024-01-24T12:44:12.306691+0000","last_fullsized":"2024-01-24T12:44:12.306691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308469+0000","last_change":"2024-01-24T12:44:10.942141+0000","last_active":"2024-01-24T12:44:12.308469+0000","last_peered":"2024-01-24T12:44:12.308469+0000","last_clean":"2024-01-24T12:44:12.308469+0000","last_became_active":"2024-01-24T12:44:10.940912+0000","last_became_peered":"2024-01-24T12:44:10.940912+0000","last_unstale":"2024-01-24T12:44:12.308469+0000","last_undegraded":"2024-01-24T12:44:12.308469+0000","last_fullsized":"2024-01-24T12:44:12.308469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309938+0000","last_change":"2024-01-24T12:44:11.351939+0000","last_active":"2024-01-24T12:44:12.309938+0000","last_peered":"2024-01-24T12:44:12.309938+0000","last_clean":"2024-01-24T12:44:12.309938+0000","last_became_active":"2024-01-24T12:44:11.351433+0000","last_became_peered":"2024-01-24T12:44:11.351433+0000","last_unstale":"2024-01-24T12:44:12.309938+0000","last_undegraded":"2024-01-24T12:44:12.309938+0000","last_fullsized":"2024-01-24T12:44:12.309938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297489+0000","last_change":"2024-01-24T12:44:10.937971+0000","last_active":"2024-01-24T12:44:12.297489+0000","last_peered":"2024-01-24T12:44:12.297489+0000","last_clean":"2024-01-24T12:44:12.297489+0000","last_became_active":"2024-01-24T12:44:10.937130+0000","last_became_peered":"2024-01-24T12:44:10.937130+0000","last_unstale":"2024-01-24T12:44:12.297489+0000","last_undegraded":"2024-01-24T12:44:12.297489+0000","last_fullsized":"2024-01-24T12:44:12.297489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297341+0000","last_change":"2024-01-24T12:44:11.317998+0000","last_active":"2024-01-24T12:44:12.297341+0000","last_peered":"2024-01-24T12:44:12.297341+0000","last_clean":"2024-01-24T12:44:12.297341+0000","last_became_active":"2024-01-24T12:44:11.313220+0000","last_became_peered":"2024-01-24T12:44:11.313220+0000","last_unstale":"2024-01-24T12:44:12.297341+0000","last_undegraded":"2024-01-24T12:44:12.297341+0000","last_fullsized":"2024-01-24T12:44:12.297341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307832+0000","last_change":"2024-01-24T12:44:10.935739+0000","last_active":"2024-01-24T12:44:12.307832+0000","last_peered":"2024-01-24T12:44:12.307832+0000","last_clean":"2024-01-24T12:44:12.307832+0000","last_became_active":"2024-01-24T12:44:10.935329+0000","last_became_peered":"2024-01-24T12:44:10.935329+0000","last_unstale":"2024-01-24T12:44:12.307832+0000","last_undegraded":"2024-01-24T12:44:12.307832+0000","last_fullsized":"2024-01-24T12:44:12.307832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309364+0000","last_change":"2024-01-24T12:44:11.344235+0000","last_active":"2024-01-24T12:44:12.309364+0000","last_peered":"2024-01-24T12:44:12.309364+0000","last_clean":"2024-01-24T12:44:12.309364+0000","last_became_active":"2024-01-24T12:44:11.343638+0000","last_became_peered":"2024-01-24T12:44:11.343638+0000","last_unstale":"2024-01-24T12:44:12.309364+0000","last_undegraded":"2024-01-24T12:44:12.309364+0000","last_fullsized":"2024-01-24T12:44:12.309364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:43.676453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300535+0000","last_change":"2024-01-24T12:44:10.934962+0000","last_active":"2024-01-24T12:44:12.300535+0000","last_peered":"2024-01-24T12:44:12.300535+0000","last_clean":"2024-01-24T12:44:12.300535+0000","last_became_active":"2024-01-24T12:44:10.934179+0000","last_became_peered":"2024-01-24T12:44:10.934179+0000","last_unstale":"2024-01-24T12:44:12.300535+0000","last_undegraded":"2024-01-24T12:44:12.300535+0000","last_fullsized":"2024-01-24T12:44:12.300535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310395+0000","last_change":"2024-01-24T12:44:11.345146+0000","last_active":"2024-01-24T12:44:12.310395+0000","last_peered":"2024-01-24T12:44:12.310395+0000","last_clean":"2024-01-24T12:44:12.310395+0000","last_became_active":"2024-01-24T12:44:11.343454+0000","last_became_peered":"2024-01-24T12:44:11.343454+0000","last_unstale":"2024-01-24T12:44:12.310395+0000","last_undegraded":"2024-01-24T12:44:12.310395+0000","last_fullsized":"2024-01-24T12:44:12.310395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:45:06.184578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308221+0000","last_change":"2024-01-24T12:44:10.941647+0000","last_active":"2024-01-24T12:44:12.308221+0000","last_peered":"2024-01-24T12:44:12.308221+0000","last_clean":"2024-01-24T12:44:12.308221+0000","last_became_active":"2024-01-24T12:44:10.941177+0000","last_became_peered":"2024-01-24T12:44:10.941177+0000","last_unstale":"2024-01-24T12:44:12.308221+0000","last_undegraded":"2024-01-24T12:44:12.308221+0000","last_fullsized":"2024-01-24T12:44:12.308221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310690+0000","last_change":"2024-01-24T12:44:11.350856+0000","last_active":"2024-01-24T12:44:12.310690+0000","last_peered":"2024-01-24T12:44:12.310690+0000","last_clean":"2024-01-24T12:44:12.310690+0000","last_became_active":"2024-01-24T12:44:11.350244+0000","last_became_peered":"2024-01-24T12:44:11.350244+0000","last_unstale":"2024-01-24T12:44:12.310690+0000","last_undegraded":"2024-01-24T12:44:12.310690+0000","last_fullsized":"2024-01-24T12:44:12.310690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:31:04.636860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308635+0000","last_change":"2024-01-24T12:44:10.937540+0000","last_active":"2024-01-24T12:44:12.308635+0000","last_peered":"2024-01-24T12:44:12.308635+0000","last_clean":"2024-01-24T12:44:12.308635+0000","last_became_active":"2024-01-24T12:44:10.937246+0000","last_became_peered":"2024-01-24T12:44:10.937246+0000","last_unstale":"2024-01-24T12:44:12.308635+0000","last_undegraded":"2024-01-24T12:44:12.308635+0000","last_fullsized":"2024-01-24T12:44:12.308635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309138+0000","last_change":"2024-01-24T12:44:11.345714+0000","last_active":"2024-01-24T12:44:12.309138+0000","last_peered":"2024-01-24T12:44:12.309138+0000","last_clean":"2024-01-24T12:44:12.309138+0000","last_became_active":"2024-01-24T12:44:11.340127+0000","last_became_peered":"2024-01-24T12:44:11.340127+0000","last_unstale":"2024-01-24T12:44:12.309138+0000","last_undegraded":"2024-01-24T12:44:12.309138+0000","last_fullsized":"2024-01-24T12:44:12.309138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307978+0000","last_change":"2024-01-24T12:44:10.946919+0000","last_active":"2024-01-24T12:44:12.307978+0000","last_peered":"2024-01-24T12:44:12.307978+0000","last_clean":"2024-01-24T12:44:12.307978+0000","last_became_active":"2024-01-24T12:44:10.946607+0000","last_became_peered":"2024-01-24T12:44:10.946607+0000","last_unstale":"2024-01-24T12:44:12.307978+0000","last_undegraded":"2024-01-24T12:44:12.307978+0000","last_fullsized":"2024-01-24T12:44:12.307978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310112+0000","last_change":"2024-01-24T12:44:11.357380+0000","last_active":"2024-01-24T12:44:12.310112+0000","last_peered":"2024-01-24T12:44:12.310112+0000","last_clean":"2024-01-24T12:44:12.310112+0000","last_became_active":"2024-01-24T12:44:11.356720+0000","last_became_peered":"2024-01-24T12:44:11.356720+0000","last_unstale":"2024-01-24T12:44:12.310112+0000","last_undegraded":"2024-01-24T12:44:12.310112+0000","last_fullsized":"2024-01-24T12:44:12.310112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-24T12:44:11.307644+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:11.307644+0000","last_peered":"2024-01-24T12:44:11.307644+0000","last_clean":"2024-01-24T12:44:11.307644+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:11.307644+0000","last_undegraded":"2024-01-24T12:44:11.307644+0000","last_fullsized":"2024-01-24T12:44:11.307644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309210+0000","last_change":"2024-01-24T12:44:10.932841+0000","last_active":"2024-01-24T12:44:12.309210+0000","last_peered":"2024-01-24T12:44:12.309210+0000","last_clean":"2024-01-24T12:44:12.309210+0000","last_became_active":"2024-01-24T12:44:10.931862+0000","last_became_peered":"2024-01-24T12:44:10.931862+0000","last_unstale":"2024-01-24T12:44:12.309210+0000","last_undegraded":"2024-01-24T12:44:12.309210+0000","last_fullsized":"2024-01-24T12:44:12.309210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295950+0000","last_change":"2024-01-24T12:44:11.356544+0000","last_active":"2024-01-24T12:44:12.295950+0000","last_peered":"2024-01-24T12:44:12.295950+0000","last_clean":"2024-01-24T12:44:12.295950+0000","last_became_active":"2024-01-24T12:44:11.356289+0000","last_became_peered":"2024-01-24T12:44:11.356289+0000","last_unstale":"2024-01-24T12:44:12.295950+0000","last_undegraded":"2024-01-24T12:44:12.295950+0000","last_fullsized":"2024-01-24T12:44:12.295950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.954636+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.953755+0000","last_became_peered":"2024-01-24T12:44:10.953755+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306843+0000","last_change":"2024-01-24T12:44:11.322569+0000","last_active":"2024-01-24T12:44:12.306843+0000","last_peered":"2024-01-24T12:44:12.306843+0000","last_clean":"2024-01-24T12:44:12.306843+0000","last_became_active":"2024-01-24T12:44:11.322253+0000","last_became_peered":"2024-01-24T12:44:11.322253+0000","last_unstale":"2024-01-24T12:44:12.306843+0000","last_undegraded":"2024-01-24T12:44:12.306843+0000","last_fullsized":"2024-01-24T12:44:12.306843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308008+0000","last_change":"2024-01-24T12:44:10.941900+0000","last_active":"2024-01-24T12:44:12.308008+0000","last_peered":"2024-01-24T12:44:12.308008+0000","last_clean":"2024-01-24T12:44:12.308008+0000","last_became_active":"2024-01-24T12:44:10.941526+0000","last_became_peered":"2024-01-24T12:44:10.941526+0000","last_unstale":"2024-01-24T12:44:12.308008+0000","last_undegraded":"2024-01-24T12:44:12.308008+0000","last_fullsized":"2024-01-24T12:44:12.308008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307635+0000","last_change":"2024-01-24T12:44:11.306700+0000","last_active":"2024-01-24T12:44:12.307635+0000","last_peered":"2024-01-24T12:44:12.307635+0000","last_clean":"2024-01-24T12:44:12.307635+0000","last_became_active":"2024-01-24T12:44:11.306420+0000","last_became_peered":"2024-01-24T12:44:11.306420+0000","last_unstale":"2024-01-24T12:44:12.307635+0000","last_undegraded":"2024-01-24T12:44:12.307635+0000","last_fullsized":"2024-01-24T12:44:12.307635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308705+0000","last_change":"2024-01-24T12:44:10.939127+0000","last_active":"2024-01-24T12:44:12.308705+0000","last_peered":"2024-01-24T12:44:12.308705+0000","last_clean":"2024-01-24T12:44:12.308705+0000","last_became_active":"2024-01-24T12:44:10.936034+0000","last_became_peered":"2024-01-24T12:44:10.936034+0000","last_unstale":"2024-01-24T12:44:12.308705+0000","last_undegraded":"2024-01-24T12:44:12.308705+0000","last_fullsized":"2024-01-24T12:44:12.308705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300705+0000","last_change":"2024-01-24T12:44:11.326553+0000","last_active":"2024-01-24T12:44:12.300705+0000","last_peered":"2024-01-24T12:44:12.300705+0000","last_clean":"2024-01-24T12:44:12.300705+0000","last_became_active":"2024-01-24T12:44:11.322735+0000","last_became_peered":"2024-01-24T12:44:11.322735+0000","last_unstale":"2024-01-24T12:44:12.300705+0000","last_undegraded":"2024-01-24T12:44:12.300705+0000","last_fullsized":"2024-01-24T12:44:12.300705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308725+0000","last_change":"2024-01-24T12:44:10.932249+0000","last_active":"2024-01-24T12:44:12.308725+0000","last_peered":"2024-01-24T12:44:12.308725+0000","last_clean":"2024-01-24T12:44:12.308725+0000","last_became_active":"2024-01-24T12:44:10.931916+0000","last_became_peered":"2024-01-24T12:44:10.931916+0000","last_unstale":"2024-01-24T12:44:12.308725+0000","last_undegraded":"2024-01-24T12:44:12.308725+0000","last_fullsized":"2024-01-24T12:44:12.308725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308828+0000","last_change":"2024-01-24T12:44:11.341472+0000","last_active":"2024-01-24T12:44:12.308828+0000","last_peered":"2024-01-24T12:44:12.308828+0000","last_clean":"2024-01-24T12:44:12.308828+0000","last_became_active":"2024-01-24T12:44:11.339574+0000","last_became_peered":"2024-01-24T12:44:11.339574+0000","last_unstale":"2024-01-24T12:44:12.308828+0000","last_undegraded":"2024-01-24T12:44:12.308828+0000","last_fullsized":"2024-01-24T12:44:12.308828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310484+0000","last_change":"2024-01-24T12:44:10.954824+0000","last_active":"2024-01-24T12:44:12.310484+0000","last_peered":"2024-01-24T12:44:12.310484+0000","last_clean":"2024-01-24T12:44:12.310484+0000","last_became_active":"2024-01-24T12:44:10.953995+0000","last_became_peered":"2024-01-24T12:44:10.953995+0000","last_unstale":"2024-01-24T12:44:12.310484+0000","last_undegraded":"2024-01-24T12:44:12.310484+0000","last_fullsized":"2024-01-24T12:44:12.310484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:46.778299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308748+0000","last_change":"2024-01-24T12:44:11.306822+0000","last_active":"2024-01-24T12:44:12.308748+0000","last_peered":"2024-01-24T12:44:12.308748+0000","last_clean":"2024-01-24T12:44:12.308748+0000","last_became_active":"2024-01-24T12:44:11.306582+0000","last_became_peered":"2024-01-24T12:44:11.306582+0000","last_unstale":"2024-01-24T12:44:12.308748+0000","last_undegraded":"2024-01-24T12:44:12.308748+0000","last_fullsized":"2024-01-24T12:44:12.308748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308811+0000","last_change":"2024-01-24T12:44:10.945081+0000","last_active":"2024-01-24T12:44:12.308811+0000","last_peered":"2024-01-24T12:44:12.308811+0000","last_clean":"2024-01-24T12:44:12.308811+0000","last_became_active":"2024-01-24T12:44:10.944818+0000","last_became_peered":"2024-01-24T12:44:10.944818+0000","last_unstale":"2024-01-24T12:44:12.308811+0000","last_undegraded":"2024-01-24T12:44:12.308811+0000","last_fullsized":"2024-01-24T12:44:12.308811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296235+0000","last_change":"2024-01-24T12:44:11.338803+0000","last_active":"2024-01-24T12:44:12.296235+0000","last_peered":"2024-01-24T12:44:12.296235+0000","last_clean":"2024-01-24T12:44:12.296235+0000","last_became_active":"2024-01-24T12:44:11.338477+0000","last_became_peered":"2024-01-24T12:44:11.338477+0000","last_unstale":"2024-01-24T12:44:12.296235+0000","last_undegraded":"2024-01-24T12:44:12.296235+0000","last_fullsized":"2024-01-24T12:44:12.296235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298588+0000","last_change":"2024-01-24T12:44:10.939339+0000","last_active":"2024-01-24T12:44:12.298588+0000","last_peered":"2024-01-24T12:44:12.298588+0000","last_clean":"2024-01-24T12:44:12.298588+0000","last_became_active":"2024-01-24T12:44:10.938406+0000","last_became_peered":"2024-01-24T12:44:10.938406+0000","last_unstale":"2024-01-24T12:44:12.298588+0000","last_undegraded":"2024-01-24T12:44:12.298588+0000","last_fullsized":"2024-01-24T12:44:12.298588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307008+0000","last_change":"2024-01-24T12:44:11.302425+0000","last_active":"2024-01-24T12:44:12.307008+0000","last_peered":"2024-01-24T12:44:12.307008+0000","last_clean":"2024-01-24T12:44:12.307008+0000","last_became_active":"2024-01-24T12:44:11.302126+0000","last_became_peered":"2024-01-24T12:44:11.302126+0000","last_unstale":"2024-01-24T12:44:12.307008+0000","last_undegraded":"2024-01-24T12:44:12.307008+0000","last_fullsized":"2024-01-24T12:44:12.307008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308420+0000","last_change":"2024-01-24T12:44:10.954419+0000","last_active":"2024-01-24T12:44:12.308420+0000","last_peered":"2024-01-24T12:44:12.308420+0000","last_clean":"2024-01-24T12:44:12.308420+0000","last_became_active":"2024-01-24T12:44:10.953740+0000","last_became_peered":"2024-01-24T12:44:10.953740+0000","last_unstale":"2024-01-24T12:44:12.308420+0000","last_undegraded":"2024-01-24T12:44:12.308420+0000","last_fullsized":"2024-01-24T12:44:12.308420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:41.145058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299297+0000","last_change":"2024-01-24T12:44:11.323414+0000","last_active":"2024-01-24T12:44:12.299297+0000","last_peered":"2024-01-24T12:44:12.299297+0000","last_clean":"2024-01-24T12:44:12.299297+0000","last_became_active":"2024-01-24T12:44:11.321676+0000","last_became_peered":"2024-01-24T12:44:11.321676+0000","last_unstale":"2024-01-24T12:44:12.299297+0000","last_undegraded":"2024-01-24T12:44:12.299297+0000","last_fullsized":"2024-01-24T12:44:12.299297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:24.995947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308370+0000","last_change":"2024-01-24T12:44:10.932826+0000","last_active":"2024-01-24T12:44:12.308370+0000","last_peered":"2024-01-24T12:44:12.308370+0000","last_clean":"2024-01-24T12:44:12.308370+0000","last_became_active":"2024-01-24T12:44:10.931858+0000","last_became_peered":"2024-01-24T12:44:10.931858+0000","last_unstale":"2024-01-24T12:44:12.308370+0000","last_undegraded":"2024-01-24T12:44:12.308370+0000","last_fullsized":"2024-01-24T12:44:12.308370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296392+0000","last_change":"2024-01-24T12:44:11.305338+0000","last_active":"2024-01-24T12:44:12.296392+0000","last_peered":"2024-01-24T12:44:12.296392+0000","last_clean":"2024-01-24T12:44:12.296392+0000","last_became_active":"2024-01-24T12:44:11.305113+0000","last_became_peered":"2024-01-24T12:44:11.305113+0000","last_unstale":"2024-01-24T12:44:12.296392+0000","last_undegraded":"2024-01-24T12:44:12.296392+0000","last_fullsized":"2024-01-24T12:44:12.296392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308535+0000","last_change":"2024-01-24T12:44:10.943496+0000","last_active":"2024-01-24T12:44:12.308535+0000","last_peered":"2024-01-24T12:44:12.308535+0000","last_clean":"2024-01-24T12:44:12.308535+0000","last_became_active":"2024-01-24T12:44:10.943191+0000","last_became_peered":"2024-01-24T12:44:10.943191+0000","last_unstale":"2024-01-24T12:44:12.308535+0000","last_undegraded":"2024-01-24T12:44:12.308535+0000","last_fullsized":"2024-01-24T12:44:12.308535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296559+0000","last_change":"2024-01-24T12:44:11.306336+0000","last_active":"2024-01-24T12:44:12.296559+0000","last_peered":"2024-01-24T12:44:12.296559+0000","last_clean":"2024-01-24T12:44:12.296559+0000","last_became_active":"2024-01-24T12:44:11.306052+0000","last_became_peered":"2024-01-24T12:44:11.306052+0000","last_unstale":"2024-01-24T12:44:12.296559+0000","last_undegraded":"2024-01-24T12:44:12.296559+0000","last_fullsized":"2024-01-24T12:44:12.296559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310071+0000","last_change":"2024-01-24T12:44:10.959081+0000","last_active":"2024-01-24T12:44:12.310071+0000","last_peered":"2024-01-24T12:44:12.310071+0000","last_clean":"2024-01-24T12:44:12.310071+0000","last_became_active":"2024-01-24T12:44:10.956226+0000","last_became_peered":"2024-01-24T12:44:10.956226+0000","last_unstale":"2024-01-24T12:44:12.310071+0000","last_undegraded":"2024-01-24T12:44:12.310071+0000","last_fullsized":"2024-01-24T12:44:12.310071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:37.678733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297441+0000","last_change":"2024-01-24T12:44:11.335329+0000","last_active":"2024-01-24T12:44:12.297441+0000","last_peered":"2024-01-24T12:44:12.297441+0000","last_clean":"2024-01-24T12:44:12.297441+0000","last_became_active":"2024-01-24T12:44:11.334560+0000","last_became_peered":"2024-01-24T12:44:11.334560+0000","last_unstale":"2024-01-24T12:44:12.297441+0000","last_undegraded":"2024-01-24T12:44:12.297441+0000","last_fullsized":"2024-01-24T12:44:12.297441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309208+0000","last_change":"2024-01-24T12:44:11.357364+0000","last_active":"2024-01-24T12:44:12.309208+0000","last_peered":"2024-01-24T12:44:12.309208+0000","last_clean":"2024-01-24T12:44:12.309208+0000","last_became_active":"2024-01-24T12:44:11.354163+0000","last_became_peered":"2024-01-24T12:44:11.354163+0000","last_unstale":"2024-01-24T12:44:12.309208+0000","last_undegraded":"2024-01-24T12:44:12.309208+0000","last_fullsized":"2024-01-24T12:44:12.309208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309831+0000","last_change":"2024-01-24T12:44:10.954300+0000","last_active":"2024-01-24T12:44:12.309831+0000","last_peered":"2024-01-24T12:44:12.309831+0000","last_clean":"2024-01-24T12:44:12.309831+0000","last_became_active":"2024-01-24T12:44:10.953779+0000","last_became_peered":"2024-01-24T12:44:10.953779+0000","last_unstale":"2024-01-24T12:44:12.309831+0000","last_undegraded":"2024-01-24T12:44:12.309831+0000","last_fullsized":"2024-01-24T12:44:12.309831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:58.271375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308883+0000","last_change":"2024-01-24T12:44:11.343616+0000","last_active":"2024-01-24T12:44:12.308883+0000","last_peered":"2024-01-24T12:44:12.308883+0000","last_clean":"2024-01-24T12:44:12.308883+0000","last_became_active":"2024-01-24T12:44:11.342012+0000","last_became_peered":"2024-01-24T12:44:11.342012+0000","last_unstale":"2024-01-24T12:44:12.308883+0000","last_undegraded":"2024-01-24T12:44:12.308883+0000","last_fullsized":"2024-01-24T12:44:12.308883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310244+0000","last_change":"2024-01-24T12:44:10.956362+0000","last_active":"2024-01-24T12:44:12.310244+0000","last_peered":"2024-01-24T12:44:12.310244+0000","last_clean":"2024-01-24T12:44:12.310244+0000","last_became_active":"2024-01-24T12:44:10.955703+0000","last_became_peered":"2024-01-24T12:44:10.955703+0000","last_unstale":"2024-01-24T12:44:12.310244+0000","last_undegraded":"2024-01-24T12:44:12.310244+0000","last_fullsized":"2024-01-24T12:44:12.310244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:23.984897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307009+0000","last_change":"2024-01-24T12:44:11.356491+0000","last_active":"2024-01-24T12:44:12.307009+0000","last_peered":"2024-01-24T12:44:12.307009+0000","last_clean":"2024-01-24T12:44:12.307009+0000","last_became_active":"2024-01-24T12:44:11.356182+0000","last_became_peered":"2024-01-24T12:44:11.356182+0000","last_unstale":"2024-01-24T12:44:12.307009+0000","last_undegraded":"2024-01-24T12:44:12.307009+0000","last_fullsized":"2024-01-24T12:44:12.307009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296190+0000","last_change":"2024-01-24T12:44:10.934690+0000","last_active":"2024-01-24T12:44:12.296190+0000","last_peered":"2024-01-24T12:44:12.296190+0000","last_clean":"2024-01-24T12:44:12.296190+0000","last_became_active":"2024-01-24T12:44:10.934221+0000","last_became_peered":"2024-01-24T12:44:10.934221+0000","last_unstale":"2024-01-24T12:44:12.296190+0000","last_undegraded":"2024-01-24T12:44:12.296190+0000","last_fullsized":"2024-01-24T12:44:12.296190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296123+0000","last_change":"2024-01-24T12:44:11.333832+0000","last_active":"2024-01-24T12:44:12.296123+0000","last_peered":"2024-01-24T12:44:12.296123+0000","last_clean":"2024-01-24T12:44:12.296123+0000","last_became_active":"2024-01-24T12:44:11.333545+0000","last_became_peered":"2024-01-24T12:44:11.333545+0000","last_unstale":"2024-01-24T12:44:12.296123+0000","last_undegraded":"2024-01-24T12:44:12.296123+0000","last_fullsized":"2024-01-24T12:44:12.296123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307335+0000","last_change":"2024-01-24T12:44:10.950192+0000","last_active":"2024-01-24T12:44:12.307335+0000","last_peered":"2024-01-24T12:44:12.307335+0000","last_clean":"2024-01-24T12:44:12.307335+0000","last_became_active":"2024-01-24T12:44:10.949914+0000","last_became_peered":"2024-01-24T12:44:10.949914+0000","last_unstale":"2024-01-24T12:44:12.307335+0000","last_undegraded":"2024-01-24T12:44:12.307335+0000","last_fullsized":"2024-01-24T12:44:12.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:19.778 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-24T12:44:19.779 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-24T12:44:19.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-24T12:44:19.779 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-24T12:44:19.779 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-24T12:44:19.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.939+0000 7f82661da640 1 Processor -- start 2024-01-24T12:44:19.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.939+0000 7f82661da640 1 -- start start 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f82661da640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82600bc340 0x7f8260142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f82661da640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8260149470 0x7f8260153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f82661da640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8260071770 con 0x7f8260142d50 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f82661da640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82600b37e0 con 0x7f82600bc340 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f82661da640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82600b3ac0 con 0x7f8260149470 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82600bc340 0x7f8260142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82600bc340 0x7f8260142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59122/0 (socket says 172.21.15.27:59122) 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 -- 172.21.15.27:0/3429441625 learned_addr learned my addr 172.21.15.27:0/3429441625 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825ffff640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8260149470 0x7f8260153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 -- 172.21.15.27:0/3429441625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8260149470 msgr2=0x7f8260153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8260149470 0x7f8260153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 -- 172.21.15.27:0/3429441625 >> v1:172.21.15.124:6789/0 conn(0x7f8260142d50 legacy=0x7f8260148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:19.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 -- 172.21.15.27:0/3429441625 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600b3da0 con 0x7f82600bc340 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825f7fe640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82600bc340 0x7f8260142810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d7d1f42ed4dc3c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825e7fc640 1 -- 172.21.15.27:0/3429441625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480a89b0 con 0x7f82600bc340 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825e7fc640 1 -- 172.21.15.27:0/3429441625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82480a8b10 con 0x7f82600bc340 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.943+0000 7f825e7fc640 1 -- 172.21.15.27:0/3429441625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480a8ea0 con 0x7f82600bc340 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/3429441625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82600bc340 msgr2=0x7f8260142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82600bc340 0x7f8260142810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824801ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/3429441625 shutdown_connections 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8260149470 0x7f8260153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- 172.21.15.27:0/3429441625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82600bc340 0x7f8260142810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/3429441625 >> 172.21.15.27:0/3429441625 conn(0x7f8260069ef0 msgr2=0x7f826006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/3429441625 shutdown_connections 2024-01-24T12:44:19.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/3429441625 wait complete. 2024-01-24T12:44:19.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 Processor -- start 2024-01-24T12:44:19.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- start start 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 0x7f82601e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8260149470 0x7f8260141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82601e0160 con 0x7f82601e0590 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82601e0f60 con 0x7f8260149470 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82601420d0 con 0x7f82600bc340 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59128/0 (socket says 172.21.15.27:59128) 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 -- 172.21.15.27:0/1445478728 learned_addr learned my addr 172.21.15.27:0/1445478728 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:19.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825effd640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8260149470 0x7f8260141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825f7fe640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 0x7f82601e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 -- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 msgr2=0x7f82601e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 0x7f82601e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 -- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8260149470 msgr2=0x7f8260141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8260149470 0x7f8260141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 -- 172.21.15.27:0/1445478728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480094d0 con 0x7f82601e0590 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825f7fe640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 0x7f82601e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f825ffff640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f825800d560 tx=0x7f825800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580125f0 con 0x7f82601e0590 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258012770 con 0x7f82601e0590 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82601e3d60 con 0x7f82601e0590 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258012b20 con 0x7f82601e0590 2024-01-24T12:44:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.947+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82601e4320 con 0x7f82601e0590 2024-01-24T12:44:19.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82601e44e0 con 0x7f82601e0590 2024-01-24T12:44:19.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8258012c80 con 0x7f82601e0590 2024-01-24T12:44:19.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f8257fff640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 0x7f8240067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:19.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82580834e0 con 0x7f82601e0590 2024-01-24T12:44:19.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f825f7fe640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 0x7f8240067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:19.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.951+0000 7f825f7fe640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 0x7f8240067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82480b2000 tx=0x7f8248008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:19.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:19.955+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8258050f30 con 0x7f82601e0590 2024-01-24T12:44:20.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.151+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f82601e02b0 con 0x7f82601e0590 2024-01-24T12:44:20.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.155+0000 7f8257fff640 1 -- 172.21.15.27:0/1445478728 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163369 (secure 0 0 0) 0x7f82601e02b0 con 0x7f82601e0590 2024-01-24T12:44:20.160 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 msgr2=0x7f8240067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 0x7f8240067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82480b2000 tx=0x7f8248008040 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 msgr2=0x7f82601e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f825800d560 tx=0x7f825800da20 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 shutdown_connections 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8240065a90 0x7f8240067f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82601e0590 0x7f82601e0a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8260149470 0x7f8260141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 --2- 172.21.15.27:0/1445478728 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82600bc340 0x7f82601e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 >> 172.21.15.27:0/1445478728 conn(0x7f8260069ef0 msgr2=0x7f826013e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 shutdown_connections 2024-01-24T12:44:20.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.159+0000 7f82661da640 1 -- 172.21.15.27:0/1445478728 wait complete. 2024-01-24T12:44:20.177 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6832","nonce":27368},{"type":"v1","addr":"172.21.15.124:6833","nonce":27368}]},"active_addr":"172.21.15.124:6833/27368","active_change":"2024-01-24T12:43:51.609474+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":2348968309}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1385876280}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":454514198}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.124:0","nonce":1673002909}]}]} 2024-01-24T12:44:20.181 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-24T12:44:20.181 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-24T12:44:20.181 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:20.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.295+0000 7f73785ae640 1 Processor -- start 2024-01-24T12:44:20.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.295+0000 7f73785ae640 1 -- start start 2024-01-24T12:44:20.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f73785ae640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 0x7f737006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f73785ae640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f73785ae640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700707e0 con 0x7f7370144d70 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f73785ae640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700703c0 con 0x7f73700bc340 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f73785ae640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73700b8750 con 0x7f737006f4f0 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f737634a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 0x7f737006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:55750/0 (socket says 172.21.15.27:55750) 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7376b4b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7370144d70 0x7f737014ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:47572/0 (socket says 172.21.15.27:47572) 2024-01-24T12:44:20.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 -- 172.21.15.27:0/3048416461 learned_addr learned my addr 172.21.15.27:0/3048416461 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 -- 172.21.15.27:0/3048416461 >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 msgr2=0x7f737006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 --2- 172.21.15.27:0/3048416461 >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 0x7f737006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 -- 172.21.15.27:0/3048416461 >> v1:172.21.15.124:6789/0 conn(0x7f7370144d70 legacy=0x7f737014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f7375b49640 1 -- 172.21.15.27:0/3048416461 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737006fa10 con 0x7f737006f4f0 2024-01-24T12:44:20.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.299+0000 7f737634a640 1 --2- 172.21.15.27:0/3048416461 >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 0x7f737006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:20.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375b49640 1 --2- 172.21.15.27:0/3048416461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7360009870 tx=0x7f736001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363ff20a6758117b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375348640 1 -- 172.21.15.27:0/3048416461 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600ab660 con 0x7f737006f4f0 2024-01-24T12:44:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375348640 1 -- 172.21.15.27:0/3048416461 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73600ab7c0 con 0x7f737006f4f0 2024-01-24T12:44:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375348640 1 -- 172.21.15.27:0/3048416461 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600abb50 con 0x7f737006f4f0 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3048416461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 msgr2=0x7f7370144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- 172.21.15.27:0/3048416461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7360009870 tx=0x7f736001c480 comp rx=0 tx=0).stop 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3048416461 shutdown_connections 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- 172.21.15.27:0/3048416461 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f737006f4f0 0x7f7370144830 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- 172.21.15.27:0/3048416461 >> v2:172.21.15.124:3300/0 conn(0x7f73700bc340 0x7f737006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3048416461 >> 172.21.15.27:0/3048416461 conn(0x7f7370069ef0 msgr2=0x7f737006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3048416461 shutdown_connections 2024-01-24T12:44:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3048416461 wait complete. 2024-01-24T12:44:20.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 Processor -- start 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- start start 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 0x7f73701409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7370144d70 0x7f7370140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370139d50 con 0x7f737006f4f0 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370139b40 con 0x7f7370144d70 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7370140560 con 0x7f73700bc340 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59142/0 (socket says 172.21.15.27:59142) 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 -- 172.21.15.27:0/3479081213 learned_addr learned my addr 172.21.15.27:0/3479081213 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375b49640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 0x7f73701409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7376b4b640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7370144d70 0x7f7370140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 -- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 msgr2=0x7f73701409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 0x7f73701409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 -- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7370144d70 msgr2=0x7f7370140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7370144d70 0x7f7370140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 -- 172.21.15.27:0/3479081213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c009420 con 0x7f737006f4f0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7375b49640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 0x7f73701409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f737634a640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ebe0 tx=0x7f736c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00eee0 con 0x7f737006f4f0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c00cc30 con 0x7f737006f4f0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600094d0 con 0x7f737006f4f0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c013470 con 0x7f737006f4f0 2024-01-24T12:44:20.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.303+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73701e6a80 con 0x7f737006f4f0 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737004e000 con 0x7f737006f4f0 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f736c0135d0 con 0x7f737006f4f0 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f7366ffd640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 0x7f7354067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f736c0837a0 con 0x7f737006f4f0 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f7375b49640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 0x7f7354067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.307+0000 7f7375b49640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 0x7f7354067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73600af000 tx=0x7f73600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.311+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f736c0511f0 con 0x7f737006f4f0 2024-01-24T12:44:20.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.463+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7370143470 con 0x7f737006f4f0 2024-01-24T12:44:20.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.463+0000 7f7366ffd640 1 -- 172.21.15.27:0/3479081213 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f736c054810 con 0x7f737006f4f0 2024-01-24T12:44:20.466 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:20.467 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 msgr2=0x7f7354067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 0x7f7354067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73600af000 tx=0x7f73600a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 msgr2=0x7f73701e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ebe0 tx=0x7f736c00c520 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 shutdown_connections 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7354065a60 0x7f7354067f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7370144d70 0x7f7370140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73700bc340 0x7f73701409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 --2- 172.21.15.27:0/3479081213 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f737006f4f0 0x7f73701e5ee0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 >> 172.21.15.27:0/3479081213 conn(0x7f7370069ef0 msgr2=0x7f737006eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 shutdown_connections 2024-01-24T12:44:20.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.467+0000 7f73785ae640 1 -- 172.21.15.27:0/3479081213 wait complete. 2024-01-24T12:44:20.485 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-24T12:44:20.485 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 Processor -- start 2024-01-24T12:44:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 -- start start 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c80bc340 0x7f59c8142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59c8142d50 0x7f59c8148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f59c81492a0 0x7f59c80b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c8071770 con 0x7f59c8142d50 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c81496d0 con 0x7f59c81492a0 2024-01-24T12:44:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59cccf0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b37e0 con 0x7f59c80bc340 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59c8142d50 0x7f59c8148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59c8142d50 0x7f59c8148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59150/0 (socket says 172.21.15.27:59150) 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 -- 172.21.15.27:0/3347739098 learned_addr learned my addr 172.21.15.27:0/3347739098 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c659c640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c80bc340 0x7f59c8142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c6d9d640 1 --2- 172.21.15.27:0/3347739098 >> v2:172.21.15.124:3300/0 conn(0x7f59c81492a0 0x7f59c80b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 -- 172.21.15.27:0/3347739098 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c80bc340 msgr2=0x7f59c8142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c80bc340 0x7f59c8142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 -- 172.21.15.27:0/3347739098 >> v2:172.21.15.124:3300/0 conn(0x7f59c81492a0 msgr2=0x7f59c80b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/3347739098 >> v2:172.21.15.124:3300/0 conn(0x7f59c81492a0 0x7f59c80b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 -- 172.21.15.27:0/3347739098 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80b3ac0 con 0x7f59c8142d50 2024-01-24T12:44:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c8142d50 0x7f59c8148d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59c80b9d60 tx=0x7f59b801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb0caaf40d5eb95 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.599+0000 7f59c559a640 1 -- 172.21.15.27:0/3347739098 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80a89b0 con 0x7f59c8142d50 2024-01-24T12:44:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c559a640 1 -- 172.21.15.27:0/3347739098 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80a8b10 con 0x7f59c8142d50 2024-01-24T12:44:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c559a640 1 -- 172.21.15.27:0/3347739098 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80a8ea0 con 0x7f59c8142d50 2024-01-24T12:44:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/3347739098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c8142d50 msgr2=0x7f59c8148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c8142d50 0x7f59c8148d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59c80b9d60 tx=0x7f59b801ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/3347739098 shutdown_connections 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- 172.21.15.27:0/3347739098 >> v2:172.21.15.124:3300/0 conn(0x7f59c81492a0 0x7f59c80b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c8142d50 0x7f59c8148d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- 172.21.15.27:0/3347739098 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c80bc340 0x7f59c8142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/3347739098 >> 172.21.15.27:0/3347739098 conn(0x7f59c8069ef0 msgr2=0x7f59c806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/3347739098 shutdown_connections 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/3347739098 wait complete. 2024-01-24T12:44:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 Processor -- start 2024-01-24T12:44:20.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- start start 2024-01-24T12:44:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c81492a0 0x7f59c813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f59c8135380 0x7f59c8135800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c813c160 con 0x7f59c80bc340 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c813c520 con 0x7f59c8135380 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8138f60 con 0x7f59c81492a0 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59160/0 (socket says 172.21.15.27:59160) 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 -- 172.21.15.27:0/1078861327 learned_addr learned my addr 172.21.15.27:0/1078861327 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c81492a0 0x7f59c813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c6d9d640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f59c8135380 0x7f59c8135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 -- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c81492a0 msgr2=0x7f59c813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c81492a0 0x7f59c813bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 -- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f59c8135380 msgr2=0x7f59c8135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f59c8135380 0x7f59c8135800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 -- 172.21.15.27:0/1078861327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80094d0 con 0x7f59c80bc340 2024-01-24T12:44:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59c659c640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d620 tx=0x7f59bc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0125f0 con 0x7f59c80bc340 2024-01-24T12:44:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc012750 con 0x7f59c80bc340 2024-01-24T12:44:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c8135d40 con 0x7f59c80bc340 2024-01-24T12:44:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc012ae0 con 0x7f59c80bc340 2024-01-24T12:44:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.603+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c8141f60 con 0x7f59c80bc340 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c804e000 con 0x7f59c80bc340 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59bc012c40 con 0x7f59c80bc340 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59b6ffd640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 0x7f59a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59bc083550 con 0x7f59c80bc340 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 0x7f59a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.607+0000 7f59c5d9b640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 0x7f59a8067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b2000 tx=0x7f59b80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.611+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f59bc050fa0 con 0x7f59c80bc340 2024-01-24T12:44:20.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.763+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c80b4cb0 con 0x7f59c80bc340 2024-01-24T12:44:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.767+0000 7f59b6ffd640 1 -- 172.21.15.27:0/1078861327 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f59bc007380 con 0x7f59c80bc340 2024-01-24T12:44:20.769 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:20.769 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 msgr2=0x7f59a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 0x7f59a8067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b2000 tx=0x7f59b80aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 msgr2=0x7f59c81435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d620 tx=0x7f59bc00dae0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 shutdown_connections 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f59a8065a60 0x7f59a8067f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f59c8135380 0x7f59c8135800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f59c81492a0 0x7f59c813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 --2- 172.21.15.27:0/1078861327 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59c80bc340 0x7f59c81435e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 >> 172.21.15.27:0/1078861327 conn(0x7f59c8069ef0 msgr2=0x7f59c813e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 shutdown_connections 2024-01-24T12:44:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.771+0000 7f59cccf0640 1 -- 172.21.15.27:0/1078861327 wait complete. 2024-01-24T12:44:20.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-24T12:44:20.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-24T12:44:20.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-24T12:44:20.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-24T12:44:20.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-24T12:44:20.789 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-24T12:44:20.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-24T12:44:20.790 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-24T12:44:20.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 Processor -- start 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 -- start start 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa39c0b2960 0x7fa39c06be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa39c14a350 0x7fa39c151240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c06ed20 con 0x7fa39c149f10 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c06c540 con 0x7fa39c14a350 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa3a0c57640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0b77b0 con 0x7fa39c0b2960 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa39bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa39c14a350 0x7fa39c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa39bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa39c14a350 0x7fa39c151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55550/0 (socket says 172.21.15.27:55550) 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa39bfff640 1 -- 172.21.15.27:0/2262388946 learned_addr learned my addr 172.21.15.27:0/2262388946 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7fa39b7fe640 1 --2- 172.21.15.27:0/2262388946 >> v2:172.21.15.124:3300/0 conn(0x7fa39c0b2960 0x7fa39c06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39bfff640 1 -- 172.21.15.27:0/2262388946 >> v2:172.21.15.124:3300/0 conn(0x7fa39c0b2960 msgr2=0x7fa39c06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39bfff640 1 --2- 172.21.15.27:0/2262388946 >> v2:172.21.15.124:3300/0 conn(0x7fa39c0b2960 0x7fa39c06be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39bfff640 1 -- 172.21.15.27:0/2262388946 >> v1:172.21.15.124:6789/0 conn(0x7fa39c149f10 legacy=0x7fa39c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 Processor -- start 2024-01-24T12:44:20.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39a7fc640 1 -- 172.21.15.27:0/2262388946 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150148356 0 0) 0x7fa39c06ed20 con 0x7fa39c149f10 2024-01-24T12:44:20.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39bfff640 1 -- 172.21.15.27:0/2262388946 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0b7a90 con 0x7fa39c14a350 2024-01-24T12:44:20.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 -- start start 2024-01-24T12:44:20.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.963+0000 7f4cd86ae640 1 Processor -- start 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd86ae640 1 -- start start 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd86ae640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 0x7f4cd014f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd86ae640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd014ec40 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd86ae640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd00b8010 con 0x7f4cd00a11b0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd86ae640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd014faa0 con 0x7f4cd014f0d0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd5c49640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4cd00b7bb0 0x7f4cd0148a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40490/0 (socket says 172.21.15.27:40490) 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd5c49640 1 -- 172.21.15.27:0/3637499861 learned_addr learned my addr 172.21.15.27:0/3637499861 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd6c4b640 1 --2- 172.21.15.27:0/3637499861 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 0x7f4cd014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd5448640 1 -- 172.21.15.27:0/3637499861 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693190303 0 0) 0x7f4cd014ec40 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd5448640 1 -- 172.21.15.27:0/3637499861 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc003530 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd6c4b640 1 -- 172.21.15.27:0/3637499861 >> v1:172.21.15.124:6789/0 conn(0x7f4cd00a11b0 legacy=0x7f4cd006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd6c4b640 1 -- 172.21.15.27:0/3637499861 >> v1:172.21.15.27:6789/0 conn(0x7f4cd00b7bb0 legacy=0x7f4cd0148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7f4cd6c4b640 1 -- 172.21.15.27:0/3637499861 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd006bc90 con 0x7f4cd014f0d0 2024-01-24T12:44:20.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc780007290 0x7fc78003c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78003c050 con 0x7fc78003a420 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78003a8b0 con 0x7fc7800384f0 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc790786640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78003c9b0 con 0x7fc780007290 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc78dd21640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc78003a420 0x7fc78003e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40506/0 (socket says 172.21.15.27:40506) 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc78dd21640 1 -- 172.21.15.27:0/4163893819 learned_addr learned my addr 172.21.15.27:0/4163893819 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc78e522640 1 --2- 172.21.15.27:0/4163893819 >> v2:172.21.15.124:3300/0 conn(0x7fc780007290 0x7fc78003c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc78d520640 1 -- 172.21.15.27:0/4163893819 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735296458 0 0) 0x7fc78003c050 con 0x7fc78003a420 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fc78d520640 1 -- 172.21.15.27:0/4163893819 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003530 con 0x7fc78003a420 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78e522640 1 -- 172.21.15.27:0/4163893819 >> v1:172.21.15.124:6789/0 conn(0x7fc7800384f0 legacy=0x7fc7800dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78e522640 1 -- 172.21.15.27:0/4163893819 >> v1:172.21.15.27:6789/0 conn(0x7fc78003a420 legacy=0x7fc78003e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78e522640 1 -- 172.21.15.27:0/4163893819 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78003ab90 con 0x7fc780007290 2024-01-24T12:44:20.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.967+0000 7fa39bfff640 1 --2- 172.21.15.27:0/2262388946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c14a350 0x7fa39c151240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa39c06d6f0 tx=0x7fa39001e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3b49b995de8fe3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 Processor -- start 2024-01-24T12:44:20.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd6c4b640 1 --2- 172.21.15.27:0/3637499861 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 0x7f4cd014f560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009dc0 tx=0x7f4cc801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ee8f24e238c7ef server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa39a7fc640 1 -- 172.21.15.27:0/2262388946 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3900a7920 con 0x7fa39c14a350 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa39a7fc640 1 -- 172.21.15.27:0/2262388946 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3900a7a80 con 0x7fa39c14a350 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa39a7fc640 1 -- 172.21.15.27:0/2262388946 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3900a7e10 con 0x7fa39c14a350 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd5448640 1 -- 172.21.15.27:0/3637499861 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80af600 con 0x7f4cd014f0d0 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd5448640 1 -- 172.21.15.27:0/3637499861 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc80ab050 con 0x7f4cd014f0d0 2024-01-24T12:44:20.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd5448640 1 -- 172.21.15.27:0/3637499861 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80af960 con 0x7f4cd014f0d0 2024-01-24T12:44:20.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 -- start start 2024-01-24T12:44:20.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 0x7fda3c0b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 -- 172.21.15.27:0/2262388946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c14a350 msgr2=0x7fa39c151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 --2- 172.21.15.27:0/2262388946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c14a350 0x7fa39c151240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa39c06d6f0 tx=0x7fa39001e870 comp rx=0 tx=0).stop 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c06c340 con 0x7fda3c146fe0 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c14a650 con 0x7fda3c0b7950 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda44093640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c06c7d0 con 0x7fda3c0b2810 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda42630640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fda3c146fe0 0x7fda3c147430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40512/0 (socket says 172.21.15.27:40512) 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda42630640 1 -- 172.21.15.27:0/2472349577 learned_addr learned my addr 172.21.15.27:0/2472349577 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda4162e640 1 --2- 172.21.15.27:0/2472349577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 0x7fda3c0b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- 172.21.15.27:0/3637499861 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 msgr2=0x7f4cd014f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 --2- 172.21.15.27:0/3637499861 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 0x7f4cd014f560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009dc0 tx=0x7f4cc801f150 comp rx=0 tx=0).stop 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- 172.21.15.27:0/3637499861 shutdown_connections 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 --2- 172.21.15.27:0/3637499861 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd014f0d0 0x7f4cd014f560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- 172.21.15.27:0/3637499861 >> 172.21.15.27:0/3637499861 conn(0x7f4cd00bbd20 msgr2=0x7f4cd00bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- 172.21.15.27:0/3637499861 shutdown_connections 2024-01-24T12:44:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- 172.21.15.27:0/3637499861 wait complete. 2024-01-24T12:44:20.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 -- 172.21.15.27:0/2262388946 shutdown_connections 2024-01-24T12:44:20.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 --2- 172.21.15.27:0/2262388946 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c14a350 0x7fa39c151240 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 --2- 172.21.15.27:0/2262388946 >> v2:172.21.15.124:3300/0 conn(0x7fa39c0b2960 0x7fa39c06be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 -- 172.21.15.27:0/2262388946 >> 172.21.15.27:0/2262388946 conn(0x7fa39c0b8770 msgr2=0x7fa39c0b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f62acf7a640 1 Processor -- start 2024-01-24T12:44:20.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f53d5729640 1 Processor -- start 2024-01-24T12:44:20.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78e522640 1 --2- 172.21.15.27:0/4163893819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc780007290 0x7fc78003c470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7840097c0 tx=0x7fc78401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e886e6463ee19fe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 Processor -- start 2024-01-24T12:44:20.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 -- 172.21.15.27:0/2262388946 shutdown_connections 2024-01-24T12:44:20.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fa3a0c57640 1 -- 172.21.15.27:0/2262388946 wait complete. 2024-01-24T12:44:20.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda4162e640 1 -- 172.21.15.27:0/2472349577 >> v1:172.21.15.124:6789/0 conn(0x7fda3c0b7950 legacy=0x7fda3c149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda4162e640 1 -- 172.21.15.27:0/2472349577 >> v1:172.21.15.27:6789/0 conn(0x7fda3c146fe0 legacy=0x7fda3c147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fda4162e640 1 -- 172.21.15.27:0/2472349577 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c06bcf0 con 0x7fda3c0b2810 2024-01-24T12:44:20.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f53d5729640 1 -- start start 2024-01-24T12:44:20.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f53d5729640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f62acf7a640 1 -- start start 2024-01-24T12:44:20.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78d520640 1 -- 172.21.15.27:0/4163893819 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840a8990 con 0x7fc780007290 2024-01-24T12:44:20.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78d520640 1 -- 172.21.15.27:0/4163893819 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840a8af0 con 0x7fc780007290 2024-01-24T12:44:20.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7fc78d520640 1 -- 172.21.15.27:0/4163893819 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840a8e80 con 0x7fc780007290 2024-01-24T12:44:20.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 Processor -- start 2024-01-24T12:44:20.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 -- start start 2024-01-24T12:44:20.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f53ceffd640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f53d00b1470 0x7f53d006c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40502/0 (socket says 172.21.15.27:40502) 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 Processor -- start 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.971+0000 7f4cd86ae640 1 -- start start 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd00a11b0 0x7f4cd00baee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cd00b7bb0 0x7f4cd00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cd014f0d0 0x7f4cd01d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01d87c0 con 0x7f4cd014f0d0 2024-01-24T12:44:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 -- start start 2024-01-24T12:44:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd00bb420 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01d8200 con 0x7f4cd00a11b0 2024-01-24T12:44:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- 172.21.15.27:0/4163893819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc780007290 msgr2=0x7fc78003c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 --2- 172.21.15.27:0/4163893819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc780007290 0x7fc78003c470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7840097c0 tx=0x7fc78401ec90 comp rx=0 tx=0).stop 2024-01-24T12:44:20.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62a814eb40 0x7f62a80b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda4162e640 1 --2- 172.21.15.27:0/2472349577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 0x7fda3c0b7d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097f0 tx=0x7fda2c01c200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf25ad0f88a951a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 0x7f62a8069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a80b9440 0x7f62a814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd644a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd00a11b0 0x7f4cd00baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd644a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd00a11b0 0x7f4cd00baee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53718/0 (socket says 172.21.15.27:53718) 2024-01-24T12:44:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd644a640 1 -- 172.21.15.27:0/2516163487 learned_addr learned my addr 172.21.15.27:0/2516163487 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cd00b7bb0 0x7f4cd00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0ddc0b5e50 0x7f0ddc149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a8145070 con 0x7f62a814eb40 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80b9190 con 0x7f62a806a940 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62acf7a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a806fc80 con 0x7f62a80b9440 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc14a470 con 0x7f0ddc06a840 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc070960 con 0x7f0ddc0b84b0 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de469e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc070c40 con 0x7f0ddc0b5e50 2024-01-24T12:44:20.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- 172.21.15.27:0/4163893819 shutdown_connections 2024-01-24T12:44:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 --2- 172.21.15.27:0/4163893819 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc780007290 0x7fc78003c470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- 172.21.15.27:0/4163893819 >> 172.21.15.27:0/4163893819 conn(0x7fc78003efb0 msgr2=0x7fc78003f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd6c4b640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cd014f0d0 0x7f4cd01d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda40e2d640 1 -- 172.21.15.27:0/2472349577 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0ab600 con 0x7fda3c0b2810 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- 172.21.15.27:0/4163893819 shutdown_connections 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa39c0b2960 0x7fa39c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c149f10 0x7fa39c1ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa39c14a350 0x7fa39c0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b4c90 con 0x7fa39c149f10 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c070720 con 0x7fa39c14a350 2024-01-24T12:44:20.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62a814eb40 0x7f62a80b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f62a814eb40 0x7f62a80b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55576/0 (socket says 172.21.15.27:55576) 2024-01-24T12:44:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 -- 172.21.15.27:0/4048120283 learned_addr learned my addr 172.21.15.27:0/4048120283 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda40e2d640 1 -- 172.21.15.27:0/2472349577 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c0a7050 con 0x7fda3c0b2810 2024-01-24T12:44:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda40e2d640 1 -- 172.21.15.27:0/2472349577 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0ab980 con 0x7fda3c0b2810 2024-01-24T12:44:20.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa3a0c57640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c143a40 con 0x7fa39c0b2960 2024-01-24T12:44:20.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f629effd640 1 --2- 172.21.15.27:0/4048120283 >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 0x7f62a8069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 -- 172.21.15.27:0/4048120283 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a80b9440 msgr2=0x7f62a814a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 --2- 172.21.15.27:0/4048120283 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a80b9440 0x7f62a814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 -- 172.21.15.27:0/4048120283 >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 msgr2=0x7f62a8069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 --2- 172.21.15.27:0/4048120283 >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 0x7f62a8069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f62a77fe640 1 -- 172.21.15.27:0/4048120283 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a806ff60 con 0x7f62a814eb40 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 -- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd00a11b0 msgr2=0x7f4cd00baee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4cd00a11b0 0x7f4cd00baee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 -- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cd014f0d0 msgr2=0x7f4cd01d92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4cd014f0d0 0x7f4cd01d92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc8009a70 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de1c39640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f0ddc0b84b0 0x7f0ddc070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40510/0 (socket says 172.21.15.27:40510) 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de1c39640 1 -- 172.21.15.27:0/694543943 learned_addr learned my addr 172.21.15.27:0/694543943 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de243a640 1 --2- 172.21.15.27:0/694543943 >> v2:172.21.15.124:3300/0 conn(0x7f0ddc0b5e50 0x7f0ddc149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f629effd640 1 --2- 172.21.15.27:0/4048120283 >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 0x7f62a8069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa39c14a350 0x7fa39c0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39bfff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa39c14a350 0x7fa39c0b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52368/0 (socket says 172.21.15.27:52368) 2024-01-24T12:44:20.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39bfff640 1 -- 172.21.15.27:0/297924278 learned_addr learned my addr 172.21.15.27:0/297924278 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:20.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 -- 172.21.15.27:0/2472349577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 msgr2=0x7fda3c0b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 --2- 172.21.15.27:0/2472349577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 0x7fda3c0b7d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0097f0 tx=0x7fda2c01c200 comp rx=0 tx=0).stop 2024-01-24T12:44:20.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd5c49640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cd00b7bb0 0x7f4cd00b1660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000c400 tx=0x7f4cc000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 -- 172.21.15.27:0/2472349577 shutdown_connections 2024-01-24T12:44:20.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39b7fe640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa39c0b2960 0x7fa39c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c149f10 0x7fa39c1ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 --2- 172.21.15.27:0/2472349577 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c0b2810 0x7fda3c0b7d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 -- 172.21.15.27:0/2472349577 >> 172.21.15.27:0/2472349577 conn(0x7fda3c0bbd20 msgr2=0x7fda3c0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:20.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- 172.21.15.27:0/4163893819 wait complete. 2024-01-24T12:44:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 -- 172.21.15.27:0/2472349577 shutdown_connections 2024-01-24T12:44:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 Processor -- start 2024-01-24T12:44:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fda44093640 1 -- 172.21.15.27:0/2472349577 wait complete. 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 -- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa39c0b2960 msgr2=0x7fa39c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa39c0b2960 0x7fa39c0b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 -- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa39c14a350 msgr2=0x7fa39c0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa39c14a350 0x7fa39c0b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900094d0 con 0x7fa39c149f10 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f53ce7fc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:20.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f53ce7fc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53744/0 (socket says 172.21.15.27:53744) 2024-01-24T12:44:20.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa39affd640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c149f10 0x7fa39c1ea8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c450 tx=0x7fa38c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:20.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f53ceffd640 1 -- 172.21.15.27:0/2209176715 learned_addr learned my addr 172.21.15.27:0/2209176715 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:20.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0005cf0 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0005e50 con 0x7f4cd00b7bb0 2024-01-24T12:44:20.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00072d0 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd01d84e0 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd014c5a0 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0054e0 con 0x7fa39c149f10 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c003600 con 0x7fa39c149f10 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c003990 con 0x7fa39c149f10 2024-01-24T12:44:21.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4cd006c250 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fa3a0c57640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c144a50 con 0x7fa39c149f10 2024-01-24T12:44:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fa3a0c57640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0703b0 con 0x7fa39c149f10 2024-01-24T12:44:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00b7b30 con 0x7f53d00b1850 2024-01-24T12:44:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00b7dd0 con 0x7f53d00b1470 2024-01-24T12:44:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b27a0 con 0x7f53d00a15b0 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- start start 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc780007290 0x7fc7800d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 0x7fc7800ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7800d7870 0x7fc7800ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78001c3e0 con 0x7fc7800384f0 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800d0e00 con 0x7fc7800d7870 2024-01-24T12:44:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7fc790786640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78001d0b0 con 0x7fc780007290 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 Processor -- start 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 -- start start 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de243a640 1 -- 172.21.15.27:0/694543943 >> v1:172.21.15.124:6789/0 conn(0x7f0ddc0b84b0 legacy=0x7f0ddc070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de243a640 1 -- 172.21.15.27:0/694543943 >> v1:172.21.15.27:6789/0 conn(0x7f0ddc06a840 legacy=0x7f0ddc1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.975+0000 7f0de243a640 1 -- 172.21.15.27:0/694543943 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc06f100 con 0x7f0ddc0b5e50 2024-01-24T12:44:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fa3a0c57640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa39c0b2d40 con 0x7fa39c149f10 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 0x7fc7800ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 0x7fc7800ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55594/0 (socket says 172.21.15.27:55594) 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 -- 172.21.15.27:0/2962977313 learned_addr learned my addr 172.21.15.27:0/2962977313 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78ed23640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7800d7870 0x7fc7800ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78e522640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc780007290 0x7fc7800d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53cdffb640 1 -- 172.21.15.27:0/2209176715 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30910272 0 0) 0x7f53d00b7dd0 con 0x7f53d00b1470 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53cdffb640 1 -- 172.21.15.27:0/2209176715 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b8003530 con 0x7f53d00b1470 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62a77fe640 1 --2- 172.21.15.27:0/4048120283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a814eb40 0x7f62a80b8c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62a8073a00 tx=0x7f629801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aada5dc1a11bdae0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 -- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc780007290 msgr2=0x7fc7800d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc780007290 0x7fc7800d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 -- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7800d7870 msgr2=0x7fc7800ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc7800d7870 0x7fc7800ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784009420 con 0x7fc7800384f0 2024-01-24T12:44:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de243a640 1 --2- 172.21.15.27:0/694543943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc0b5e50 0x7f0ddc149f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800aea0 tx=0x7f0dd801d440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be0539799a0b940 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3c0b2810 0x7fda3c148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda3c0b7950 0x7fda3c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de1438640 1 -- 172.21.15.27:0/694543943 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd800a2d0 con 0x7f0ddc0b5e50 2024-01-24T12:44:21.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc78dd21640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 0x7fc7800ce280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c420 tx=0x7fc77800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62a6ffd640 1 -- 172.21.15.27:0/4048120283 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980ac640 con 0x7f62a814eb40 2024-01-24T12:44:21.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62a6ffd640 1 -- 172.21.15.27:0/4048120283 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62980ac7a0 con 0x7f62a814eb40 2024-01-24T12:44:21.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62a6ffd640 1 -- 172.21.15.27:0/4048120283 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980acb30 con 0x7f62a814eb40 2024-01-24T12:44:21.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de1438640 1 -- 172.21.15.27:0/694543943 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80a5b80 con 0x7f0ddc0b5e50 2024-01-24T12:44:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda41e2f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3c0b2810 0x7fda3c148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda41e2f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3c0b2810 0x7fda3c148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52372/0 (socket says 172.21.15.27:52372) 2024-01-24T12:44:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778005cf0 con 0x7fc7800384f0 2024-01-24T12:44:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda4162e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda3c0b7950 0x7fda3c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda4162e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda3c0b7950 0x7fda3c0b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55596/0 (socket says 172.21.15.27:55596) 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda41e2f640 1 -- 172.21.15.27:0/1471923574 learned_addr learned my addr 172.21.15.27:0/1471923574 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c146fe0 0x7fda3c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78001b890 con 0x7fc7800384f0 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78001be50 con 0x7fc7800384f0 2024-01-24T12:44:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c148840 con 0x7fda3c0b7950 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c0b3560 con 0x7fda3c0b2810 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c1496f0 con 0x7fda3c146fe0 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62acf7a640 1 -- 172.21.15.27:0/4048120283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a814eb40 msgr2=0x7f62a80b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f62acf7a640 1 --2- 172.21.15.27:0/4048120283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a814eb40 0x7f62a80b8c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62a8073a00 tx=0x7f629801c4c0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4cc0007430 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cb4065b30 0x7f4cb4067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cc0083220 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f4cb406dd50 0x7f4cb4070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4cb4070820 con 0x7f4cb406dd50 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cc00835d0 con 0x7f4cd00b7bb0 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 -- 172.21.15.27:0/694543943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc0b5e50 msgr2=0x7f0ddc149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 --2- 172.21.15.27:0/694543943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc0b5e50 0x7f0ddc149f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800aea0 tx=0x7f0dd801d440 comp rx=0 tx=0).stop 2024-01-24T12:44:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7fda42630640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c146fe0 0x7fda3c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 -- 172.21.15.27:0/694543943 shutdown_connections 2024-01-24T12:44:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 --2- 172.21.15.27:0/694543943 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc0b5e50 0x7f0ddc149f30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 -- 172.21.15.27:0/694543943 >> 172.21.15.27:0/694543943 conn(0x7f0ddc069d20 msgr2=0x7f0ddc06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 -- 172.21.15.27:0/694543943 shutdown_connections 2024-01-24T12:44:21.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f4cd644a640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cb4065b30 0x7f4cb4067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f4cd6c4b640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f4cb406dd50 0x7f4cb4070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 -- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3c0b2810 msgr2=0x7fda3c148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fda3c0b2810 0x7fda3c148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 -- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda3c0b7950 msgr2=0x7fda3c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda3c0b7950 0x7fda3c0b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c009420 con 0x7fda3c146fe0 2024-01-24T12:44:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f0de469e640 1 -- 172.21.15.27:0/694543943 wait complete. 2024-01-24T12:44:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53ce7fc640 1 -- 172.21.15.27:0/2209176715 >> v1:172.21.15.124:6789/0 conn(0x7f53d00b1470 legacy=0x7f53d006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53ce7fc640 1 -- 172.21.15.27:0/2209176715 >> v1:172.21.15.27:6789/0 conn(0x7f53d00b1850 legacy=0x7f53d0159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.979+0000 7f53ce7fc640 1 -- 172.21.15.27:0/2209176715 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00b80b0 con 0x7f53d00a15b0 2024-01-24T12:44:21.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda42630640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c146fe0 0x7fda3c0b48f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda34001610 tx=0x7fda3400bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa38c003af0 con 0x7fa39c149f10 2024-01-24T12:44:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f4cd644a640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cb4065b30 0x7f4cb4067ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0018b0 tx=0x7f4ccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc78003e140 con 0x7fc7800384f0 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- 172.21.15.27:0/4048120283 shutdown_connections 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- 172.21.15.27:0/4048120283 >> v2:172.21.15.124:3300/0 conn(0x7f62a806a940 0x7f62a8069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- 172.21.15.27:0/4048120283 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a80b9440 0x7f62a814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- 172.21.15.27:0/4048120283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a814eb40 0x7f62a80b8c50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- 172.21.15.27:0/4048120283 >> 172.21.15.27:0/4048120283 conn(0x7f62a80b98f0 msgr2=0x7f62a80b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f4cd6c4b640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f4cb406dd50 0x7f4cb4070170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34019a50 con 0x7fda3c146fe0 2024-01-24T12:44:21.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34019bb0 con 0x7fda3c146fe0 2024-01-24T12:44:21.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa388065ab0 0x7fa388067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778005e50 con 0x7fc7800384f0 2024-01-24T12:44:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- 172.21.15.27:0/4048120283 shutdown_connections 2024-01-24T12:44:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa38c082dd0 con 0x7fa39c149f10 2024-01-24T12:44:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780072d0 con 0x7fc7800384f0 2024-01-24T12:44:21.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 Processor -- start 2024-01-24T12:44:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c0b4260 con 0x7fda3c146fe0 2024-01-24T12:44:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c154bf0 con 0x7fda3c146fe0 2024-01-24T12:44:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== osd.2 v2:172.21.15.27:6824/27566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4cb4070820 con 0x7f4cb406dd50 2024-01-24T12:44:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3400be80 con 0x7fda3c146fe0 2024-01-24T12:44:21.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda24000fd0 con 0x7fda3c146fe0 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 -- start start 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc06a840 0x7f0ddc13ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ddc0b5e50 0x7f0ddc0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 0x7f0ddc149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc13b1c0 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc148920 con 0x7f0ddc06a840 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de469e640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b0450 con 0x7f0ddc0b5e50 2024-01-24T12:44:21.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 0x7f0ddc149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 0x7f0ddc149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55598/0 (socket says 172.21.15.27:55598) 2024-01-24T12:44:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 -- 172.21.15.27:0/1207546864 learned_addr learned my addr 172.21.15.27:0/1207546864 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- 172.21.15.27:0/4048120283 wait complete. 2024-01-24T12:44:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 Processor -- start 2024-01-24T12:44:21.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7fa38806dcd0 0x7fa3880700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3880707a0 con 0x7fa38806dcd0 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38c083270 con 0x7fa39c149f10 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fa39b7fe640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa388065ab0 0x7fa388067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 -- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ddc0b5e50 msgr2=0x7f0ddc0b0cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ddc0b5e50 0x7f0ddc0b0cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 -- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc06a840 msgr2=0x7f0ddc13ac80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ddc06a840 0x7f0ddc13ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd800ab80 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f0de2c3b640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 0x7f0ddc149890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00ecc0 tx=0x7f0dcc00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- start start 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a806a940 0x7f62a80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 0x7f62a81efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62a814eb40 0x7f62a81effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80b4910 con 0x7f62a80b9440 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a814d190 con 0x7f62a814eb40 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7f62acf7a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a814c820 con 0x7f62a806a940 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 0x7f62a81efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 0x7f62a81efa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55604/0 (socket says 172.21.15.27:55604) 2024-01-24T12:44:21.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 -- 172.21.15.27:0/1199168359 learned_addr learned my addr 172.21.15.27:0/1199168359 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fa39bfff640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7fa38806dcd0 0x7fa3880700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f62a77fe640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a806a940 0x7f62a80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f62a7fff640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62a814eb40 0x7f62a81effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda3400c6a0 con 0x7fda3c146fe0 2024-01-24T12:44:21.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 -- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a806a940 msgr2=0x7f62a80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f62a806a940 0x7f62a80b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 -- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62a814eb40 msgr2=0x7f62a81effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f62a814eb40 0x7f62a81effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980094d0 con 0x7f62a80b9440 2024-01-24T12:44:21.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fda20065ab0 0x7fda20067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda3408e7e0 con 0x7fda3c146fe0 2024-01-24T12:44:21.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7fda2006dcd0 0x7fda200700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fa39bfff640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7fa38806dcd0 0x7fa3880700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda200707a0 con 0x7fda2006dcd0 2024-01-24T12:44:21.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda3408ec80 con 0x7fda3c146fe0 2024-01-24T12:44:21.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda41e2f640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fda20065ab0 0x7fda20067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f629effd640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 0x7f62a81efa70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f629000d800 tx=0x7f629000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fa39b7fe640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa388065ab0 0x7fa388067f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa394003bb0 tx=0x7fa39400c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda4162e640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7fda2006dcd0 0x7fda200700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53ce7fc640 1 --2- 172.21.15.27:0/2209176715 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097f0 tx=0x7f53c001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453dd265a68a0f76 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc778007530 con 0x7fc7800384f0 2024-01-24T12:44:21.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc76c065be0 0x7fc76c0680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc778082790 con 0x7fc7800384f0 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fc76c06de00 0x7fc76c070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc76c0708d0 con 0x7fc76c06de00 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.983+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc778084ce0 con 0x7fc7800384f0 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fc78ed23640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fc76c06de00 0x7fc76c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53cdffb640 1 -- 172.21.15.27:0/2209176715 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00ac640 con 0x7f53d00a15b0 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53cdffb640 1 -- 172.21.15.27:0/2209176715 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00ac7a0 con 0x7f53d00a15b0 2024-01-24T12:44:21.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53cdffb640 1 -- 172.21.15.27:0/2209176715 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00acb30 con 0x7f53d00a15b0 2024-01-24T12:44:21.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda4162e640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7fda2006dcd0 0x7fda200700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fc78ed23640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fc76c06de00 0x7fc76c070220 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda41e2f640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fda20065ab0 0x7fda20067f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda38001a70 tx=0x7fda38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fc78e522640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc76c065be0 0x7fc76c0680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== osd.0 v2:172.21.15.27:6808/27569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc76c0708d0 con 0x7fc76c06de00 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== osd.3 v2:172.21.15.27:6800/27568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fda200707a0 con 0x7fda2006dcd0 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00cd50 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc004020 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0b1200 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004390 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc147a80 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 msgr2=0x7f53d01522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 --2- 172.21.15.27:0/2209176715 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097f0 tx=0x7f53c001c400 comp rx=0 tx=0).stop 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 shutdown_connections 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 --2- 172.21.15.27:0/2209176715 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00a15b0 0x7f53d01522c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 >> 172.21.15.27:0/2209176715 conn(0x7f53d00bbd20 msgr2=0x7f53d00bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 shutdown_connections 2024-01-24T12:44:21.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7f53d5729640 1 -- 172.21.15.27:0/2209176715 wait complete. 2024-01-24T12:44:21.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.987+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== osd.6 v2:172.21.15.124:6824/27690 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa3880707a0 con 0x7fa38806dcd0 2024-01-24T12:44:21.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7fc78e522640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc76c065be0 0x7fc76c0680a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc7840b2000 tx=0x7fc784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0dc4000fd0 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 Processor -- start 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0dcc003600 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0dd2ffd640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0dc0065b30 0x7f0dc0067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dcc086050 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0dd2ffd640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7f0dc006dcd0 0x7f0dc00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0dc00707a0 con 0x7f0dc006dcd0 2024-01-24T12:44:21.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 -- start start 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 0x7f53d0140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00b1470 0x7f53d0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f53d00b1850 0x7f53d0141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d01414d0 con 0x7f53d00a15b0 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0148be0 con 0x7f53d00b1850 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53d5729640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0146ec0 con 0x7f53d00b1470 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 0x7f53d0140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 0x7f53d0140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55618/0 (socket says 172.21.15.27:55618) 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 -- 172.21.15.27:0/2553916977 learned_addr learned my addr 172.21.15.27:0/2553916977 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 -- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00b1470 msgr2=0x7f53d0150bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f53d00b1470 0x7f53d0150bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 -- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f53d00b1850 msgr2=0x7f53d0141b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f53d00b1850 0x7f53d0141b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009420 con 0x7f53d00a15b0 2024-01-24T12:44:21.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f53ceffd640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 0x7f53d0140f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c4d0 tx=0x7f53c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000b660 con 0x7f62a80b9440 2024-01-24T12:44:21.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80b5870 con 0x7f62a80b9440 2024-01-24T12:44:21.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a814ba30 con 0x7f62a80b9440 2024-01-24T12:44:21.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.991+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000b7c0 con 0x7f62a80b9440 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f0de243a640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0dc0065b30 0x7f0dc0067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f0de1c39640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7f0dc006dcd0 0x7f0dc00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dcc0044f0 con 0x7f0ddc0b84b0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4005cf0 con 0x7f53d00a15b0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4005e50 con 0x7f53d00a15b0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4007270 con 0x7f53d00a15b0 2024-01-24T12:44:21.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0148870 con 0x7f53d00a15b0 2024-01-24T12:44:21.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d0147180 con 0x7f53d00a15b0 2024-01-24T12:44:21.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f0de243a640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0dc0065b30 0x7f0dc0067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ae000 tx=0x7f0dd80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53d015d450 con 0x7f53d00a15b0 2024-01-24T12:44:21.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f0de1c39640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7f0dc006dcd0 0x7f0dc00700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53c40073d0 con 0x7f53d00a15b0 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f53bc065ab0 0x7f53bc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53c40831e0 con 0x7f53d00a15b0 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f53bc06dcd0 0x7f53bc0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53bc0707a0 con 0x7f53bc06dcd0 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53c4083550 con 0x7f53d00a15b0 2024-01-24T12:44:21.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.995+0000 7f53ce7fc640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f53bc065ab0 0x7f53bc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000bb70 con 0x7f62a80b9440 2024-01-24T12:44:21.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f628c000fd0 con 0x7f62a80b9440 2024-01-24T12:44:21.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f629000bcd0 con 0x7f62a80b9440 2024-01-24T12:44:21.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f53cf7fe640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f53bc06dcd0 0x7f53bc0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6288065be0 0x7f62880680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f53ce7fc640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f53bc065ab0 0x7f53bc067f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53c00ae000 tx=0x7f53c00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6290083560 con 0x7f62a80b9440 2024-01-24T12:44:21.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f628806dc90 0x7f62880700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f53cf7fe640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f53bc06dcd0 0x7f53bc0700f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a77fe640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6288065be0 0x7f62880680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6288070760 con 0x7f628806dc90 2024-01-24T12:44:21.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6290085a30 con 0x7f62a80b9440 2024-01-24T12:44:21.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a7fff640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f628806dc90 0x7f62880700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== osd.4 v2:172.21.15.124:6804/27688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0dc00707a0 con 0x7f0dc006dcd0 2024-01-24T12:44:21.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a7fff640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f628806dc90 0x7f62880700b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f62a77fe640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6288065be0 0x7f62880680a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62980ae000 tx=0x7f62980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:20.999+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== osd.7 v2:172.21.15.124:6800/27691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f53bc0707a0 con 0x7f53bc06dcd0 2024-01-24T12:44:21.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.007+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 --> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda24002cf0 con 0x7fda2006dcd0 2024-01-24T12:44:21.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== osd.1 v2:172.21.15.27:6810/27567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6288070760 con 0x7f628806dc90 2024-01-24T12:44:21.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda327fc640 1 -- 172.21.15.27:0/1471923574 <== osd.3 v2:172.21.15.27:6800/27568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda24002cf0 con 0x7fda2006dcd0 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7fda2006dcd0 msgr2=0x7fda200700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7fda2006dcd0 0x7fda200700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fda20065ab0 msgr2=0x7fda20067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fda20065ab0 0x7fda20067f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda38001a70 tx=0x7fda38009040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c146fe0 msgr2=0x7fda3c0b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 --2- 172.21.15.27:0/1471923574 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fda3c146fe0 0x7fda3c0b48f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda34001610 tx=0x7fda3400bc30 comp rx=0 tx=0).stop 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda42630640 1 -- 172.21.15.27:0/1471923574 reap_dead start 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 shutdown_connections 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 >> 172.21.15.27:0/1471923574 conn(0x7fda3c0bbd20 msgr2=0x7fda3c0baba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 shutdown_connections 2024-01-24T12:44:21.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 Processor -- start 2024-01-24T12:44:21.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fda44093640 1 -- 172.21.15.27:0/1471923574 wait complete. 2024-01-24T12:44:21.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 -- start start 2024-01-24T12:44:21.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 0x7f82bc0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 0x7f82bc0d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc03ff90 con 0x7f82bc006f90 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc03d920 con 0x7f82bc007370 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c90b6640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc03b080 con 0x7f82bc0c92d0 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c3fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f82bc006f90 0x7f82bc0cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40552/0 (socket says 172.21.15.27:40552) 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7f82c3fff640 1 -- 172.21.15.27:0/3102706518 learned_addr learned my addr 172.21.15.27:0/3102706518 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:21.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.011+0000 7fa3a0c57640 1 -- 172.21.15.27:0/297924278 --> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa39c06d380 con 0x7fa38806dcd0 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c88b5640 1 --2- 172.21.15.27:0/3102706518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 0x7f82bc0d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c37fe640 1 --2- 172.21.15.27:0/3102706518 >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 0x7f82bc0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c88b5640 1 -- 172.21.15.27:0/3102706518 >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 msgr2=0x7f82bc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c88b5640 1 --2- 172.21.15.27:0/3102706518 >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 0x7f82bc0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c88b5640 1 -- 172.21.15.27:0/3102706518 >> v1:172.21.15.27:6789/0 conn(0x7f82bc006f90 legacy=0x7f82bc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7f82c88b5640 1 -- 172.21.15.27:0/3102706518 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0401e0 con 0x7f82bc0c92d0 2024-01-24T12:44:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 --> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc78003ae70 con 0x7fc76c06de00 2024-01-24T12:44:21.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa383fff640 1 -- 172.21.15.27:0/297924278 <== osd.6 v2:172.21.15.124:6824/27690 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa39000c040 con 0x7fa38806dcd0 2024-01-24T12:44:21.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fc77effd640 1 -- 172.21.15.27:0/2962977313 <== osd.0 v2:172.21.15.27:6808/27569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc78804e850 con 0x7fc76c06de00 2024-01-24T12:44:21.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7fa38806dcd0 msgr2=0x7fa3880700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7fa38806dcd0 0x7fa3880700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa388065ab0 msgr2=0x7fa388067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa388065ab0 0x7fa388067f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa394003bb0 tx=0x7fa39400c040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c149f10 msgr2=0x7fa39c1ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 --2- 172.21.15.27:0/297924278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa39c149f10 0x7fa39c1ea8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c450 tx=0x7fa38c00c910 comp rx=0 tx=0).stop 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa39bfff640 1 -- 172.21.15.27:0/297924278 reap_dead start 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 shutdown_connections 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.015+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 >> 172.21.15.27:0/297924278 conn(0x7fa39c0b8770 msgr2=0x7fa39c0baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 shutdown_connections 2024-01-24T12:44:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c37fe640 1 --2- 172.21.15.27:0/3102706518 >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 0x7f82bc0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:21.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7fa381ffb640 1 -- 172.21.15.27:0/297924278 wait complete. 2024-01-24T12:44:21.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c88b5640 1 --2- 172.21.15.27:0/3102706518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 0x7f82bc0d96c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82c4074440 tx=0x7f82c40962d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7864d03666f659 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c2ffd640 1 -- 172.21.15.27:0/3102706518 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4125600 con 0x7f82bc0c92d0 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c2ffd640 1 -- 172.21.15.27:0/3102706518 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4121050 con 0x7f82bc0c92d0 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- 172.21.15.27:0/3102706518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 msgr2=0x7f82bc0d96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 --2- 172.21.15.27:0/3102706518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 0x7f82bc0d96c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82c4074440 tx=0x7f82c40962d0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- 172.21.15.27:0/3102706518 shutdown_connections 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 --2- 172.21.15.27:0/3102706518 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c92d0 0x7f82bc0d96c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 --2- 172.21.15.27:0/3102706518 >> v2:172.21.15.27:3300/0 conn(0x7f82bc007370 0x7f82bc0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- 172.21.15.27:0/3102706518 >> 172.21.15.27:0/3102706518 conn(0x7f82bc006210 msgr2=0x7f82bc006620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- 172.21.15.27:0/3102706518 shutdown_connections 2024-01-24T12:44:21.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 --> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4cd006bf70 con 0x7f4cb406dd50 2024-01-24T12:44:21.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f4cc6ffd640 1 -- 172.21.15.27:0/2516163487 <== osd.2 v2:172.21.15.27:6824/27566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4cc8003be0 con 0x7f4cb406dd50 2024-01-24T12:44:21.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- 172.21.15.27:0/3102706518 wait complete. 2024-01-24T12:44:21.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 Processor -- start 2024-01-24T12:44:21.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.019+0000 7f82c90b6640 1 -- start start 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 0x7f82bc0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82bc007370 0x7f82bc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c4a30 0x7f82bc0c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0cab60 con 0x7f82bc007370 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0d8d00 con 0x7f82bc006f90 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc009980 con 0x7f82bc0c4a30 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 0x7f82bc0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 0x7f82bc0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52398/0 (socket says 172.21.15.27:52398) 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 -- 172.21.15.27:0/1452531591 learned_addr learned my addr 172.21.15.27:0/1452531591 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c88b5640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c4a30 0x7f82bc0c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c37fe640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82bc007370 0x7f82bc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 -- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c4a30 msgr2=0x7f82bc0c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f82bc0c4a30 0x7f82bc0c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 -- 172.21.15.27:0/1452531591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82bc007370 msgr2=0x7f82bc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82bc007370 0x7f82bc0cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009420 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c37fe640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82bc007370 0x7f82bc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c3fff640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 0x7f82bc0ca620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c780 tx=0x7f82b800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80072d0 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8007430 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80047f0 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc0cbab0 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.023+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc0d8f50 con 0x7f82bc006f90 2024-01-24T12:44:21.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f4cb406dd50 msgr2=0x7f4cb4070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 --> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0dc4002cf0 con 0x7f0dc006dcd0 2024-01-24T12:44:21.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f4cb406dd50 0x7f4cb4070170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cb4065b30 msgr2=0x7f4cb4067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82bc0077b0 con 0x7f82bc006f90 2024-01-24T12:44:21.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4cb4065b30 0x7f4cb4067ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0018b0 tx=0x7f4ccc009040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cd00b7bb0 msgr2=0x7f4cd00b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 --2- 172.21.15.27:0/2516163487 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4cd00b7bb0 0x7f4cd00b1660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000c400 tx=0x7f4cc000c8c0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd6c4b640 1 -- 172.21.15.27:0/2516163487 reap_dead start 2024-01-24T12:44:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 shutdown_connections 2024-01-24T12:44:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 >> 172.21.15.27:0/2516163487 conn(0x7f4cd00bbd20 msgr2=0x7f4cd0144a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 shutdown_connections 2024-01-24T12:44:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0dd2ffd640 1 -- 172.21.15.27:0/1207546864 <== osd.4 v2:172.21.15.124:6804/27688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0dc4002cf0 con 0x7f0dc006dcd0 2024-01-24T12:44:21.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f4cd86ae640 1 -- 172.21.15.27:0/2516163487 wait complete. 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7f0dc006dcd0 msgr2=0x7f0dc00700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7f0dc006dcd0 0x7f0dc00700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0dc0065b30 msgr2=0x7f0dc0067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0dc0065b30 0x7f0dc0067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ae000 tx=0x7f0dd80a7070 comp rx=0 tx=0).stop 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 msgr2=0x7f0ddc149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de469e640 1 --2- 172.21.15.27:0/1207546864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ddc0b84b0 0x7f0ddc149890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00ecc0 tx=0x7f0dcc00c430 comp rx=0 tx=0).stop 2024-01-24T12:44:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f0de2c3b640 1 -- 172.21.15.27:0/1207546864 reap_dead start 2024-01-24T12:44:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 --> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53d0148d20 con 0x7f53bc06dcd0 2024-01-24T12:44:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f82b8004950 con 0x7f82bc006f90 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fc76c06de00 msgr2=0x7fc76c070220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fc76c06de00 0x7fc76c070220 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc76c065be0 msgr2=0x7fc76c0680a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc76c065be0 0x7fc76c0680a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc7840b2000 tx=0x7fc784008040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 msgr2=0x7fc7800ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7fc790786640 1 --2- 172.21.15.27:0/2962977313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc7800384f0 0x7fc7800ce280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c420 tx=0x7fc77800c8e0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f82a8065a60 0x7f82a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f53b77fe640 1 -- 172.21.15.27:0/2553916977 <== osd.7 v2:172.21.15.124:6800/27691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53c8001cd0 con 0x7f53bc06dcd0 2024-01-24T12:44:21.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82b8082d40 con 0x7f82bc006f90 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f82a806dc00 0x7f82a8070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82a80706d0 con 0x7f82a806dc00 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b8083190 con 0x7f82bc006f90 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c37fe640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f82a8065a60 0x7f82a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f82c88b5640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f82a806dc00 0x7f82a8070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f53bc06dcd0 msgr2=0x7f53bc0700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.027+0000 7f53d5729640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f53bc06dcd0 0x7f53bc0700f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 shutdown_connections 2024-01-24T12:44:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 >> 172.21.15.27:0/1207546864 conn(0x7f0ddc069d20 msgr2=0x7f0ddc0b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7fc78ed23640 1 -- 172.21.15.27:0/2962977313 reap_dead start 2024-01-24T12:44:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f82c37fe640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f82a8065a60 0x7f82a8067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0d0100 tx=0x7f82b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f53bc065ab0 msgr2=0x7f53bc067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f53bc065ab0 0x7f53bc067f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53c00ae000 tx=0x7f53c00a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 msgr2=0x7f53d0140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 --2- 172.21.15.27:0/2553916977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f53d00a15b0 0x7f53d0140f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c4d0 tx=0x7f53c400c990 comp rx=0 tx=0).stop 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53cf7fe640 1 -- 172.21.15.27:0/2553916977 reap_dead start 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 shutdown_connections 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 >> 172.21.15.27:0/2553916977 conn(0x7f53d00bbd20 msgr2=0x7f53d0072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 shutdown_connections 2024-01-24T12:44:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 shutdown_connections 2024-01-24T12:44:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f82c88b5640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f82a806dc00 0x7f82a8070020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f0de469e640 1 -- 172.21.15.27:0/1207546864 wait complete. 2024-01-24T12:44:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f53d5729640 1 -- 172.21.15.27:0/2553916977 wait complete. 2024-01-24T12:44:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.031+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== osd.5 v2:172.21.15.124:6816/27689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f82a80706d0 con 0x7f82a806dc00 2024-01-24T12:44:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.035+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 shutdown_connections 2024-01-24T12:44:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.035+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 --> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f628c002cc0 con 0x7f628806dc90 2024-01-24T12:44:21.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.035+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 >> 172.21.15.27:0/2962977313 conn(0x7fc78003efb0 msgr2=0x7fc7800056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.035+0000 7f62a4ff9640 1 -- 172.21.15.27:0/1199168359 <== osd.1 v2:172.21.15.27:6810/27567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f628c002cc0 con 0x7f628806dc90 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f628806dc90 msgr2=0x7f62880700b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f628806dc90 0x7f62880700b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6288065be0 msgr2=0x7f62880680a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6288065be0 0x7f62880680a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62980ae000 tx=0x7f62980a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 msgr2=0x7f62a81efa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 --2- 172.21.15.27:0/1199168359 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f62a80b9440 0x7f62a81efa70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f629000d800 tx=0x7f629000dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62a7fff640 1 -- 172.21.15.27:0/1199168359 reap_dead start 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 shutdown_connections 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 >> 172.21.15.27:0/1199168359 conn(0x7f62a80b98f0 msgr2=0x7f62a80bc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 shutdown_connections 2024-01-24T12:44:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.039+0000 7f62acf7a640 1 -- 172.21.15.27:0/1199168359 wait complete. 2024-01-24T12:44:21.072 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:21.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-24T12:44:21.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.047+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 shutdown_connections 2024-01-24T12:44:21.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.047+0000 7fc790786640 1 -- 172.21.15.27:0/2962977313 wait complete. 2024-01-24T12:44:21.074 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:21.074 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-24T12:44:21.075 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:21.075 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-24T12:44:21.076 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:21.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-24T12:44:21.077 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 --> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82bc0077b0 con 0x7f82a806dc00 2024-01-24T12:44:21.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-24T12:44:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c0ff9640 1 -- 172.21.15.27:0/1452531591 <== osd.5 v2:172.21.15.124:6816/27689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82c4121040 con 0x7f82a806dc00 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f82a806dc00 msgr2=0x7f82a8070020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f82a806dc00 0x7f82a8070020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f82a8065a60 msgr2=0x7f82a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f82a8065a60 0x7f82a8067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0d0100 tx=0x7f82b0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 msgr2=0x7f82bc0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 --2- 172.21.15.27:0/1452531591 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f82bc006f90 0x7f82bc0ca620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c780 tx=0x7f82b800cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c88b5640 1 -- 172.21.15.27:0/1452531591 reap_dead start 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 shutdown_connections 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 >> 172.21.15.27:0/1452531591 conn(0x7f82bc006210 msgr2=0x7f82bc038490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 shutdown_connections 2024-01-24T12:44:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.059+0000 7f82c90b6640 1 -- 172.21.15.27:0/1452531591 wait complete. 2024-01-24T12:44:21.080 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:21.080 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-24T12:44:21.081 INFO:teuthology.orchestra.run.smithi027.stdout:55834574857 2024-01-24T12:44:21.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-24T12:44:21.083 INFO:teuthology.orchestra.run.smithi027.stdout:55834574857 2024-01-24T12:44:21.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-24T12:44:21.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 Processor -- start 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 -- start start 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 0x7f5dd80b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd806c340 con 0x7f5dd80b2810 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd814a650 con 0x7f5dd80b7950 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dde9e5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd806c7d0 con 0x7f5dd81476f0 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dd77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5dd80b2810 0x7f5dd8146fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40562/0 (socket says 172.21.15.27:40562) 2024-01-24T12:44:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dd77fe640 1 -- 172.21.15.27:0/1309623365 learned_addr learned my addr 172.21.15.27:0/1309623365 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5ddcf82640 1 --2- 172.21.15.27:0/1309623365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 0x7f5dd80b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dd6ffd640 1 -- 172.21.15.27:0/1309623365 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005393656 0 0) 0x7f5dd806c340 con 0x7f5dd80b2810 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5dd6ffd640 1 -- 172.21.15.27:0/1309623365 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc0003530 con 0x7f5dd80b2810 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5ddcf82640 1 -- 172.21.15.27:0/1309623365 >> v1:172.21.15.124:6789/0 conn(0x7f5dd80b7950 legacy=0x7f5dd8149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5ddcf82640 1 -- 172.21.15.27:0/1309623365 >> v1:172.21.15.27:6789/0 conn(0x7f5dd80b2810 legacy=0x7f5dd8146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.275+0000 7f5ddcf82640 1 -- 172.21.15.27:0/1309623365 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd806bcf0 con 0x7f5dd81476f0 2024-01-24T12:44:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.279+0000 7f5ddcf82640 1 --2- 172.21.15.27:0/1309623365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 0x7f5dd80b7d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0097f0 tx=0x7f5dcc01d6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19609967c46cebbf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.279+0000 7f5dd6ffd640 1 -- 172.21.15.27:0/1309623365 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0a7700 con 0x7f5dd81476f0 2024-01-24T12:44:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.279+0000 7f5dd6ffd640 1 -- 172.21.15.27:0/1309623365 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc0a7860 con 0x7f5dd81476f0 2024-01-24T12:44:21.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.279+0000 7f5dd6ffd640 1 -- 172.21.15.27:0/1309623365 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0a7bd0 con 0x7f5dd81476f0 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- 172.21.15.27:0/1309623365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 msgr2=0x7f5dd80b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 --2- 172.21.15.27:0/1309623365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 0x7f5dd80b7d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0097f0 tx=0x7f5dcc01d6c0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- 172.21.15.27:0/1309623365 shutdown_connections 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 --2- 172.21.15.27:0/1309623365 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd81476f0 0x7f5dd80b7d30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- 172.21.15.27:0/1309623365 >> 172.21.15.27:0/1309623365 conn(0x7f5dd80bbd20 msgr2=0x7f5dd80bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- 172.21.15.27:0/1309623365 shutdown_connections 2024-01-24T12:44:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- 172.21.15.27:0/1309623365 wait complete. 2024-01-24T12:44:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 Processor -- start 2024-01-24T12:44:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- start start 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd80b2810 0x7f5dd8148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd81476f0 0x7f5dd8145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80b4450 con 0x7f5dd80b7950 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8149340 con 0x7f5dd81476f0 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dde9e5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8098aa0 con 0x7f5dd80b2810 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55630/0 (socket says 172.21.15.27:55630) 2024-01-24T12:44:21.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 -- 172.21.15.27:0/2477676351 learned_addr learned my addr 172.21.15.27:0/2477676351 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd7fff640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd80b2810 0x7f5dd8148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5ddcf82640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd81476f0 0x7f5dd8145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 -- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd80b2810 msgr2=0x7f5dd8148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd80b2810 0x7f5dd8148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 -- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd81476f0 msgr2=0x7f5dd8145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd81476f0 0x7f5dd8145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.283+0000 7f5dd77fe640 1 -- 172.21.15.27:0/2477676351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc009420 con 0x7f5dd80b7950 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dd77fe640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0001b60 tx=0x7f5dd0002020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0008ea0 con 0x7f5dd80b7950 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000d6c0 con 0x7f5dd80b7950 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000da50 con 0x7f5dd80b7950 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dde9e5640 1 -- 172.21.15.27:0/2477676351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd8098d80 con 0x7f5dd80b7950 2024-01-24T12:44:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dde9e5640 1 -- 172.21.15.27:0/2477676351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd8099ff0 con 0x7f5dd80b7950 2024-01-24T12:44:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dde9e5640 1 -- 172.21.15.27:0/2477676351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd80b8650 con 0x7f5dd80b7950 2024-01-24T12:44:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.287+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5dd000dbb0 con 0x7f5dd80b7950 2024-01-24T12:44:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.291+0000 7f5dd4ff9640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 0x7f5dc4067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.291+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dd0082b80 con 0x7f5dd80b7950 2024-01-24T12:44:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f5dd7fff640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 0x7f5dc4067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 Processor -- start 2024-01-24T12:44:21.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 -- start start 2024-01-24T12:44:21.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 Processor -- start 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 -- start start 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f834c007260 0x7f834c03adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c03a900 0x7f834c0eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834c03b7d0 con 0x7f834c0ef320 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c03c860 con 0x7f834c007260 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359b32640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c03b2f0 con 0x7f834c03a900 2024-01-24T12:44:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8353fff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c03a900 0x7f834c0eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f5dd7fff640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 0x7f5dc4067f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007fd0 tx=0x7f5dc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f834c007260 0x7f834c03adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f834c007260 0x7f834c03adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52408/0 (socket says 172.21.15.27:52408) 2024-01-24T12:44:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8359331640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f834c0ef320 0x7f834c0e8ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40522/0 (socket says 172.21.15.27:40522) 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e8144b40 0x7fa3e814b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3e814bd20 0x7fa3e806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e806bff0 con 0x7fa3e806b3b0 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e814af30 con 0x7fa3e814bd20 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3eeaf4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e806c540 con 0x7fa3e8144b40 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5dd0050660 con 0x7f5dd80b7950 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3e814bd20 0x7fa3e806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa3e814bd20 0x7fa3e806bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55636/0 (socket says 172.21.15.27:55636) 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/761948840 learned_addr learned my addr 172.21.15.27:0/761948840 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/761948840 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e8144b40 msgr2=0x7fa3e814b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 --2- 172.21.15.27:0/761948840 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e8144b40 0x7fa3e814b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/761948840 >> v1:172.21.15.124:6789/0 conn(0x7fa3e806b3b0 legacy=0x7fa3e80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/761948840 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e814a8d0 con 0x7fa3e814bd20 2024-01-24T12:44:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 -- 172.21.15.27:0/1825031745 learned_addr learned my addr 172.21.15.27:0/1825031745 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 -- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c03a900 msgr2=0x7f834c0eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 --2- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c03a900 0x7f834c0eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 -- 172.21.15.27:0/1825031745 >> v1:172.21.15.124:6789/0 conn(0x7f834c0ef320 legacy=0x7f834c0e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.295+0000 7f8358b30640 1 -- 172.21.15.27:0/1825031745 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c03a280 con 0x7f834c007260 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8358b30640 1 --2- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c03adb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8340010c80 tx=0x7f8340020ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e6833a31cbaa4a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 Processor -- start 2024-01-24T12:44:21.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 -- start start 2024-01-24T12:44:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 Processor -- start 2024-01-24T12:44:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f83537fe640 1 -- 172.21.15.27:0/1825031745 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400b1440 con 0x7f834c007260 2024-01-24T12:44:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f83537fe640 1 -- 172.21.15.27:0/1825031745 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400b15a0 con 0x7f834c007260 2024-01-24T12:44:21.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f83537fe640 1 -- 172.21.15.27:0/1825031745 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400b1930 con 0x7f834c007260 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440bc310 0x7f15440b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f15440bc6f0 0x7f1544148840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f15440b3390 0x7f154414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440b49d0 con 0x7f15440b3390 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440b5ac0 con 0x7f15440bc6f0 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154bae5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15440b5480 con 0x7f15440bc310 2024-01-24T12:44:21.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3ed2f1640 1 --2- 172.21.15.27:0/761948840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e814bd20 0x7fa3e806bab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009e80 tx=0x7fa3e001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23361e48df2481df server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 -- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 msgr2=0x7f834c03adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 --2- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c03adb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8340010c80 tx=0x7f8340020ed0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 -- 172.21.15.27:0/1825031745 shutdown_connections 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 --2- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c03a900 0x7f834c0eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 --2- 172.21.15.27:0/1825031745 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c03adb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 -- 172.21.15.27:0/1825031745 >> 172.21.15.27:0/1825031745 conn(0x7f834c03ef80 msgr2=0x7f834c03f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f15440bc6f0 0x7f1544148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f15440bc6f0 0x7f1544148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52424/0 (socket says 172.21.15.27:52424) 2024-01-24T12:44:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 -- 172.21.15.27:0/2446954965 learned_addr learned my addr 172.21.15.27:0/2446954965 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 -- 172.21.15.27:0/1825031745 shutdown_connections 2024-01-24T12:44:21.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f8359b32640 1 -- 172.21.15.27:0/1825031745 wait complete. 2024-01-24T12:44:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f154a082640 1 --2- 172.21.15.27:0/2446954965 >> v2:172.21.15.27:3300/0 conn(0x7f15440b3390 0x7f154414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3ecaf0640 1 -- 172.21.15.27:0/761948840 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00a5640 con 0x7fa3e814bd20 2024-01-24T12:44:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 -- start start 2024-01-24T12:44:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 0x7f421c0b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f421c0bec80 0x7f421c159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0bbc70 con 0x7f421c0b9e50 2024-01-24T12:44:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0be0e0 con 0x7f421c0bec80 2024-01-24T12:44:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4223729640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0b8120 con 0x7f421c06b730 2024-01-24T12:44:21.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549881640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440bc310 0x7f15440b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f42214c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 0x7f421c0b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4221cc6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f421c0bec80 0x7f421c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f42214c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 0x7f421c0b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53848/0 (socket says 172.21.15.27:53848) 2024-01-24T12:44:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f42214c5640 1 -- 172.21.15.27:0/1282231312 learned_addr learned my addr 172.21.15.27:0/1282231312 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f3f0a9ea640 1 Processor -- start 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f3f0a9ea640 1 -- start start 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f0a9ea640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3f04071e50 0x7f3f04147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f0a9ea640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 0x7f3f040b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f0a9ea640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040b68b0 con 0x7f3f040b4bb0 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f0a9ea640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f040b50b0 con 0x7f3f04071e50 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f0a9ea640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040b5390 con 0x7f3f04147750 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3ecaf0640 1 -- 172.21.15.27:0/761948840 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e00a57a0 con 0x7fa3e814bd20 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3ecaf0640 1 -- 172.21.15.27:0/761948840 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00a5b30 con 0x7fa3e814bd20 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/761948840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e814bd20 msgr2=0x7fa3e806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/761948840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e814bd20 0x7fa3e806bab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009e80 tx=0x7fa3e001c9a0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/761948840 shutdown_connections 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/761948840 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e814bd20 0x7fa3e806bab0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/761948840 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e8144b40 0x7fa3e814b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/761948840 >> 172.21.15.27:0/761948840 conn(0x7fa3e80b8770 msgr2=0x7fa3e80b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/761948840 shutdown_connections 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/761948840 wait complete. 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4221cc6640 1 -- 172.21.15.27:0/1282231312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 msgr2=0x7f421c0b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4221cc6640 1 --2- 172.21.15.27:0/1282231312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 0x7f421c0b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4221cc6640 1 -- 172.21.15.27:0/1282231312 >> v1:172.21.15.27:6789/0 conn(0x7f421c0b9e50 legacy=0x7f421c0be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f4221cc6640 1 -- 172.21.15.27:0/1282231312 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0b7eb0 con 0x7f421c0bec80 2024-01-24T12:44:21.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f08f87640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3f040b4bb0 0x7f3f04149f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40582/0 (socket says 172.21.15.27:40582) 2024-01-24T12:44:21.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f08f87640 1 -- 172.21.15.27:0/2575260335 learned_addr learned my addr 172.21.15.27:0/2575260335 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:21.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f037fe640 1 --2- 172.21.15.27:0/2575260335 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 0x7f3f040b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f03fff640 1 --2- 172.21.15.27:0/2575260335 >> v2:172.21.15.27:3300/0 conn(0x7f3f04071e50 0x7f3f04147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 Processor -- start 2024-01-24T12:44:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f037fe640 1 -- 172.21.15.27:0/2575260335 >> v2:172.21.15.27:3300/0 conn(0x7f3f04071e50 msgr2=0x7f3f04147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f037fe640 1 --2- 172.21.15.27:0/2575260335 >> v2:172.21.15.27:3300/0 conn(0x7f3f04071e50 0x7f3f04147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f037fe640 1 -- 172.21.15.27:0/2575260335 >> v1:172.21.15.27:6789/0 conn(0x7f3f040b4bb0 legacy=0x7f3f04149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3f037fe640 1 -- 172.21.15.27:0/2575260335 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040b6540 con 0x7f3f04147750 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f3d6bcaa640 1 Processor -- start 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f3d6bcaa640 1 -- start start 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 -- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440bc310 msgr2=0x7f15440b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440bc310 0x7f15440b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 -- 172.21.15.27:0/2446954965 >> v2:172.21.15.27:3300/0 conn(0x7f15440b3390 msgr2=0x7f154414bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 --2- 172.21.15.27:0/2446954965 >> v2:172.21.15.27:3300/0 conn(0x7f15440b3390 0x7f154414bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.299+0000 7f1549080640 1 -- 172.21.15.27:0/2446954965 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440b5720 con 0x7f15440bc6f0 2024-01-24T12:44:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6bcaa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3d5c03ac20 0x7f3d5c03e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f1549080640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc6f0 0x7f1544148840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f154406b890 tx=0x7f153c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3eb7ceee303e45d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6bcaa640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0397f0 con 0x7f3d5c007150 2024-01-24T12:44:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6bcaa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c039ad0 con 0x7f3d5c039f60 2024-01-24T12:44:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6bcaa640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c038d30 con 0x7f3d5c03ac20 2024-01-24T12:44:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f154887f640 1 -- 172.21.15.27:0/2446954965 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0090d0 con 0x7f15440bc6f0 2024-01-24T12:44:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6a247640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f3d5c039f60 0x7f3d5c0e8b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40540/0 (socket says 172.21.15.27:40540) 2024-01-24T12:44:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d6a247640 1 -- 172.21.15.27:0/2749562423 learned_addr learned my addr 172.21.15.27:0/2749562423 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d69245640 1 --2- 172.21.15.27:0/2749562423 >> v2:172.21.15.27:3300/0 conn(0x7f3d5c03ac20 0x7f3d5c03e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d68a44640 1 -- 172.21.15.27:0/2749562423 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417702498 0 0) 0x7f3d5c039ad0 con 0x7f3d5c039f60 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d68a44640 1 -- 172.21.15.27:0/2749562423 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d50003530 con 0x7f3d5c039f60 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d69245640 1 -- 172.21.15.27:0/2749562423 >> v1:172.21.15.124:6789/0 conn(0x7f3d5c039f60 legacy=0x7f3d5c0e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d69245640 1 -- 172.21.15.27:0/2749562423 >> v1:172.21.15.27:6789/0 conn(0x7f3d5c007150 legacy=0x7f3d5c0f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f3d69245640 1 -- 172.21.15.27:0/2749562423 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c03ec40 con 0x7f3d5c03ac20 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f154887f640 1 -- 172.21.15.27:0/2446954965 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c009230 con 0x7f15440bc6f0 2024-01-24T12:44:21.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f154887f640 1 -- 172.21.15.27:0/2446954965 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0a5a90 con 0x7f15440bc6f0 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- start start 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3e806b3b0 0x7fa3e81466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e814bd20 0x7fa3e80b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8145450 con 0x7fa3e8144b40 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8147350 con 0x7fa3e806b3b0 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3eeaf4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81458e0 con 0x7fa3e814bd20 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55678/0 (socket says 172.21.15.27:55678) 2024-01-24T12:44:21.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/2551808866 learned_addr learned my addr 172.21.15.27:0/2551808866 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f4221cc6640 1 --2- 172.21.15.27:0/1282231312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c159800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f421401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccc1c48a57ca904 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ee2f3640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e814bd20 0x7fa3e80b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3edaf2640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3e806b3b0 0x7fa3e81466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e814bd20 msgr2=0x7fa3e80b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e814bd20 0x7fa3e80b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3e806b3b0 msgr2=0x7fa3e81466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3e806b3b0 0x7fa3e81466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 -- 172.21.15.27:0/2551808866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009b30 con 0x7fa3e8144b40 2024-01-24T12:44:21.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f4213fff640 1 -- 172.21.15.27:0/1282231312 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5880 con 0x7f421c0bec80 2024-01-24T12:44:21.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f4213fff640 1 -- 172.21.15.27:0/1282231312 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140a59e0 con 0x7f421c0bec80 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7fa3ed2f1640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3e001a5d0 tx=0x7fa3e0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00b8640 con 0x7fa3e8144b40 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e00b87a0 con 0x7fa3e8144b40 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00b8b10 con 0x7fa3e8144b40 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4213fff640 1 -- 172.21.15.27:0/1282231312 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5d70 con 0x7f421c0bec80 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 -- 172.21.15.27:0/1282231312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 msgr2=0x7f421c159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 --2- 172.21.15.27:0/1282231312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c159800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f421401c930 comp rx=0 tx=0).stop 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 -- 172.21.15.27:0/1282231312 shutdown_connections 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 --2- 172.21.15.27:0/1282231312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c159800 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 --2- 172.21.15.27:0/1282231312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c06b730 0x7f421c0b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f4223729640 1 -- 172.21.15.27:0/1282231312 >> 172.21.15.27:0/1282231312 conn(0x7f421c0bcd60 msgr2=0x7f421c0bd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f8359b32640 1 Processor -- start 2024-01-24T12:44:21.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 -- start start 2024-01-24T12:44:21.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f154bae5640 1 -- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc6f0 msgr2=0x7f1544148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.303+0000 7f154bae5640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc6f0 0x7f1544148840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f154406b890 tx=0x7f153c01c9f0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- 172.21.15.27:0/2446954965 shutdown_connections 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc6f0 0x7f1544148840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- 172.21.15.27:0/2446954965 >> v2:172.21.15.27:3300/0 conn(0x7f15440b3390 0x7f154414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- 172.21.15.27:0/2446954965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440bc310 0x7f15440b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- 172.21.15.27:0/2446954965 >> 172.21.15.27:0/2446954965 conn(0x7f1544069d20 msgr2=0x7f154406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- 172.21.15.27:0/2446954965 shutdown_connections 2024-01-24T12:44:21.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- 172.21.15.27:0/2446954965 wait complete. 2024-01-24T12:44:21.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f037fe640 1 --2- 172.21.15.27:0/2575260335 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 0x7f3f040b6d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000ba50 tx=0x7f3ef001eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d7128828a894a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d69245640 1 --2- 172.21.15.27:0/2749562423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c03ac20 0x7f3d5c03e700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d600089b0 tx=0x7f3d60027740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb59f14fce7ed08e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c0356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c0ef320 0x7f834c0eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c02d980 con 0x7f834c03a900 2024-01-24T12:44:21.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0317e0 con 0x7f834c007260 2024-01-24T12:44:21.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359b32640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c035c00 con 0x7f834c0ef320 2024-01-24T12:44:21.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8353fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8353fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55680/0 (socket says 172.21.15.27:55680) 2024-01-24T12:44:21.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8353fff640 1 -- 172.21.15.27:0/2498074932 learned_addr learned my addr 172.21.15.27:0/2498074932 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d68a44640 1 -- 172.21.15.27:0/2749562423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b7680 con 0x7f3d5c03ac20 2024-01-24T12:44:21.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c0356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8359331640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c0ef320 0x7f834c0eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d68a44640 1 -- 172.21.15.27:0/2749562423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600b77e0 con 0x7f3d5c03ac20 2024-01-24T12:44:21.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d68a44640 1 -- 172.21.15.27:0/2749562423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b7b90 con 0x7f3d5c03ac20 2024-01-24T12:44:21.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f02ffd640 1 -- 172.21.15.27:0/2575260335 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00a7a20 con 0x7f3f04147750 2024-01-24T12:44:21.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f02ffd640 1 -- 172.21.15.27:0/2575260335 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef00ab070 con 0x7f3f04147750 2024-01-24T12:44:21.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f02ffd640 1 -- 172.21.15.27:0/2575260335 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00a7da0 con 0x7f3f04147750 2024-01-24T12:44:21.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/2575260335 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 msgr2=0x7f3f040b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/2575260335 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 0x7f3f040b6d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000ba50 tx=0x7f3ef001eb00 comp rx=0 tx=0).stop 2024-01-24T12:44:21.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2749562423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c03ac20 msgr2=0x7f3d5c03e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2749562423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c03ac20 0x7f3d5c03e700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d600089b0 tx=0x7f3d60027740 comp rx=0 tx=0).stop 2024-01-24T12:44:21.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2749562423 shutdown_connections 2024-01-24T12:44:21.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2749562423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c03ac20 0x7f3d5c03e700 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d600089b0 tx=0x7f3d60027740 comp rx=0 tx=0).stop 2024-01-24T12:44:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2749562423 >> 172.21.15.27:0/2749562423 conn(0x7f3d5c03ee70 msgr2=0x7f3d5c03f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2749562423 shutdown_connections 2024-01-24T12:44:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2749562423 wait complete. 2024-01-24T12:44:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8071010 con 0x7fa3e8144b40 2024-01-24T12:44:21.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e80baac0 con 0x7fa3e8144b40 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 -- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c0ef320 msgr2=0x7f834c0eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c0ef320 0x7f834c0eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 -- 172.21.15.27:0/2498074932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 msgr2=0x7f834c02ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 -- 172.21.15.27:0/2498074932 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340006030 con 0x7f834c007260 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8358b30640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c0356c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83400b0000 tx=0x7f834001dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f8353fff640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 Processor -- start 2024-01-24T12:44:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- start start 2024-01-24T12:44:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80b7b90 con 0x7fa3e8144b40 2024-01-24T12:44:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440b3390 0x7f154413e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc310 0x7f1544140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/2575260335 shutdown_connections 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/2575260335 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04147750 0x7f3f040b6d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/2575260335 >> v2:172.21.15.27:3300/0 conn(0x7f3f04071e50 0x7f3f04147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/2575260335 >> 172.21.15.27:0/2575260335 conn(0x7f3f0406a120 msgr2=0x7f3f0406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544138f40 con 0x7f15440bc6f0 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15441406c0 con 0x7f15440bc310 2024-01-24T12:44:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154bae5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544142130 con 0x7f15440b3390 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/2575260335 shutdown_connections 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/2575260335 wait complete. 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f3d6bcaa640 1 Processor -- start 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- start start 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400b1440 con 0x7f834c007260 2024-01-24T12:44:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000ba60 con 0x7f834c007260 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000bdd0 con 0x7f834c007260 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154a082640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154a082640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55694/0 (socket says 172.21.15.27:55694) 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f154a082640 1 -- 172.21.15.27:0/679248881 learned_addr learned my addr 172.21.15.27:0/679248881 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f1549881640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440b3390 0x7f154413e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.307+0000 7f1549080640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc310 0x7f1544140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 -- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440b3390 msgr2=0x7f154413e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440b3390 0x7f154413e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 -- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc310 msgr2=0x7f1544140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc310 0x7f1544140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 -- 172.21.15.27:0/679248881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c009b30 con 0x7f15440bc6f0 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa3e00b8c70 con 0x7fa3e8144b40 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154a082640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f153400e850 tx=0x7f153400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- 172.21.15.27:0/1282231312 shutdown_connections 2024-01-24T12:44:21.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c19b4d0 con 0x7f834c007260 2024-01-24T12:44:21.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c19b770 con 0x7f834c007260 2024-01-24T12:44:21.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 Processor -- start 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 0x7f3d5c034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 0x7f3d5c0301b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c032880 0x7f3d5c1874c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c035030 con 0x7f3d5c032880 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c02f930 con 0x7f3d5c039f60 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c031650 con 0x7f3d5c007150 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69a46640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 0x7f3d5c034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69a46640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 0x7f3d5c034af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53880/0 (socket says 172.21.15.27:53880) 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69a46640 1 -- 172.21.15.27:0/2608360901 learned_addr learned my addr 172.21.15.27:0/2608360901 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 0x7f3d5c0301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7fa3de7fc640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 0x7fa3cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e011e000 con 0x7fa3e8144b40 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7fa3edaf2640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 0x7fa3cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534009630 con 0x7f15440bc6f0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153400c940 con 0x7f15440bc6f0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153400ccd0 con 0x7f15440bc6f0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1544142410 con 0x7f15440bc6f0 2024-01-24T12:44:21.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15440b27c0 con 0x7f15440bc6f0 2024-01-24T12:44:21.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6a247640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c032880 0x7f3d5c1874c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c005260 con 0x7f15440bc6f0 2024-01-24T12:44:21.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- 172.21.15.27:0/1282231312 wait complete. 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 Processor -- start 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 -- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 msgr2=0x7f3d5c034af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 0x7f3d5c034af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 -- 172.21.15.27:0/2608360901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c032880 msgr2=0x7f3d5c1874c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c032880 0x7f3d5c1874c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 -- 172.21.15.27:0/2608360901 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60008610 con 0x7f3d5c039f60 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d69245640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 0x7f3d5c0301b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d600b8000 tx=0x7f3d600244e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 -- start start 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3f040b4bb0 0x7f3f0414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53890/0 (socket says 172.21.15.27:53890) 2024-01-24T12:44:21.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600044d0 con 0x7f3d5c039f60 2024-01-24T12:44:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600c4070 con 0x7f3d5c039f60 2024-01-24T12:44:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- start start 2024-01-24T12:44:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c031930 con 0x7f3d5c039f60 2024-01-24T12:44:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 0x7f421c149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c0b9e50 0x7f421c148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b7b50 con 0x7f3d5c039f60 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c186ed0 con 0x7f3d5c039f60 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1494d0 con 0x7f421c0bec80 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c14a9b0 con 0x7f421c06b730 2024-01-24T12:44:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f4223729640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0b3be0 con 0x7f421c0b9e50 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f04147750 0x7f3f041e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04149580 con 0x7f3f04147750 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0414b8b0 con 0x7f3f040b4bb0 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f0a9ea640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04071000 con 0x7f3f04071e50 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f3f03fff640 1 -- 172.21.15.27:0/492961246 learned_addr learned my addr 172.21.15.27:0/492961246 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7fa3edaf2640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 0x7fa3cc067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009890 tx=0x7fa3d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f42214c5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 0x7f421c149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f42214c5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 0x7f421c149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52456/0 (socket says 172.21.15.27:52456) 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.311+0000 7f42214c5640 1 -- 172.21.15.27:0/640466267 learned_addr learned my addr 172.21.15.27:0/640466267 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 -- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3f040b4bb0 msgr2=0x7f3f0414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3f040b4bb0 0x7f3f0414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 -- 172.21.15.27:0/492961246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f04147750 msgr2=0x7f3f041e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f04147750 0x7f3f041e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 -- 172.21.15.27:0/492961246 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef000b6b0 con 0x7f3f04071e50 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 -- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c0b9e50 msgr2=0x7f421c148ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c0b9e50 0x7f421c148ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 -- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 msgr2=0x7f421c149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 0x7f421c149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 -- 172.21.15.27:0/640466267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214009a70 con 0x7f421c0bec80 2024-01-24T12:44:21.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f03fff640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e1a0 tx=0x7f3efc00e660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f4221cc6640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c14b470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f42140ac000 tx=0x7f42140196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83400b8070 con 0x7f834c007260 2024-01-24T12:44:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c02fed0 con 0x7f3d5c039f60 2024-01-24T12:44:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f83517fa640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 0x7f8338067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc010040 con 0x7f3f04071e50 2024-01-24T12:44:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f834011d450 con 0x7f834c007260 2024-01-24T12:44:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc014600 con 0x7f3f04071e50 2024-01-24T12:44:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc014970 con 0x7f3f04071e50 2024-01-24T12:44:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f8353fff640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 0x7f8338067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f04070490 con 0x7f3f04071e50 2024-01-24T12:44:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f04070c90 con 0x7f3f04071e50 2024-01-24T12:44:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f04074090 con 0x7f3f04071e50 2024-01-24T12:44:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f8353fff640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 0x7f8338067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ec670 tx=0x7f8348009300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1534013470 con 0x7f15440bc6f0 2024-01-24T12:44:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f153a7fc640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 0x7f1528067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.315+0000 7f1549881640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 0x7f1528067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d600b7cb0 con 0x7f3d5c039f60 2024-01-24T12:44:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c038140 con 0x7f834c007260 2024-01-24T12:44:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3d567fc640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 0x7f3d48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f1549881640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 0x7f1528067fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1540007a60 tx=0x7f1540008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d60129ce0 con 0x7f3d5c039f60 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3d69a46640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 0x7f3d48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3d69a46640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 0x7f3d48067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d580018b0 tx=0x7f3d58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3efc014ad0 con 0x7f3f04071e50 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3f00ff9640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 0x7f3ee8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3efc0841a0 con 0x7f3f04071e50 2024-01-24T12:44:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140ad640 con 0x7f421c0bec80 2024-01-24T12:44:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f4223729640 1 -- 172.21.15.27:0/640466267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c14ac70 con 0x7f421c0bec80 2024-01-24T12:44:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1534055130 con 0x7f15440bc6f0 2024-01-24T12:44:21.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f4223729640 1 -- 172.21.15.27:0/640466267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c0a52e0 con 0x7f421c0bec80 2024-01-24T12:44:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa3e00eba50 con 0x7fa3e8144b40 2024-01-24T12:44:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.319+0000 7f3f037fe640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 0x7f3ee8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.323+0000 7f4223729640 1 -- 172.21.15.27:0/640466267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c0b7930 con 0x7f421c0bec80 2024-01-24T12:44:21.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.323+0000 7f3f037fe640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 0x7f3ee8067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00b2000 tx=0x7f3ef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.323+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140ad7a0 con 0x7f421c0bec80 2024-01-24T12:44:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.323+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140adb10 con 0x7f421c0bec80 2024-01-24T12:44:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.323+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1534051470 con 0x7f15440bc6f0 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.327+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f42140b4070 con 0x7f421c0bec80 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.327+0000 7f4211ffb640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 0x7f4200067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.327+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421411df10 con 0x7f421c0bec80 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.327+0000 7f42214c5640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 0x7f4200067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.327+0000 7f42214c5640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 0x7f4200067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42180094a0 tx=0x7f4218009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.331+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3d600f7780 con 0x7f3d5c039f60 2024-01-24T12:44:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.331+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f42140eb830 con 0x7f421c0bec80 2024-01-24T12:44:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.331+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3efc051bd0 con 0x7f3f04071e50 2024-01-24T12:44:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.343+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f83400eaf30 con 0x7f834c007260 2024-01-24T12:44:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 Processor -- start 2024-01-24T12:44:21.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 -- start start 2024-01-24T12:44:21.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e44148f90 0x7f7e4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e44152440 0x7f7e4414f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e44149370 con 0x7f7e4414f570 2024-01-24T12:44:21.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e44071f60 con 0x7f7e44152440 2024-01-24T12:44:21.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4c615640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44152920 con 0x7f7e44148f90 2024-01-24T12:44:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4abb2640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f7e4414f570 0x7f7e440b80b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40556/0 (socket says 172.21.15.27:40556) 2024-01-24T12:44:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e4abb2640 1 -- 172.21.15.27:0/588131959 learned_addr learned my addr 172.21.15.27:0/588131959 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/588131959 >> v2:172.21.15.124:3300/0 conn(0x7f7e44152440 0x7f7e4414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e493af640 1 -- 172.21.15.27:0/588131959 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183121024 0 0) 0x7f7e3c0014a0 con 0x7f7e4414f570 2024-01-24T12:44:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e493af640 1 -- 172.21.15.27:0/588131959 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e30003530 con 0x7f7e4414f570 2024-01-24T12:44:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e49bb0640 1 -- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e44148f90 msgr2=0x7f7e4406a840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e44148f90 0x7f7e4406a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e49bb0640 1 -- 172.21.15.27:0/588131959 >> v1:172.21.15.124:6789/0 conn(0x7f7e4414f570 legacy=0x7f7e440b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.359+0000 7f7e49bb0640 1 -- 172.21.15.27:0/588131959 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44152c00 con 0x7f7e44152440 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.363+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44152440 0x7f7e4414f030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0577d76feab9df server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.363+0000 7f7e493af640 1 -- 172.21.15.27:0/588131959 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400ab600 con 0x7f7e44152440 2024-01-24T12:44:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.363+0000 7f7e493af640 1 -- 172.21.15.27:0/588131959 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e400a7050 con 0x7f7e44152440 2024-01-24T12:44:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 -- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44152440 msgr2=0x7f7e4414f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 --2- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44152440 0x7f7e4414f030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c4c0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 -- 172.21.15.27:0/588131959 shutdown_connections 2024-01-24T12:44:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 --2- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44152440 0x7f7e4414f030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 --2- 172.21.15.27:0/588131959 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e44148f90 0x7f7e4406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.367+0000 7f7e4c615640 1 -- 172.21.15.27:0/588131959 >> 172.21.15.27:0/588131959 conn(0x7f7e44069d20 msgr2=0x7f7e4406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- 172.21.15.27:0/588131959 shutdown_connections 2024-01-24T12:44:21.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- 172.21.15.27:0/588131959 wait complete. 2024-01-24T12:44:21.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 Processor -- start 2024-01-24T12:44:21.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- start start 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 0x7f7e4413ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44151930 0x7f7e440b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44150f80 con 0x7f7e44152440 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440b5940 con 0x7f7e44151930 2024-01-24T12:44:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4c615640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44150260 con 0x7f7e4414f570 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4abb2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44151930 0x7f7e440b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4a3b1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e49bb0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 0x7f7e4413ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4a3b1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:53910/0 (socket says 172.21.15.27:53910) 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.371+0000 7f7e4a3b1640 1 -- 172.21.15.27:0/3075057991 learned_addr learned my addr 172.21.15.27:0/3075057991 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 -- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44151930 msgr2=0x7f7e440b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44151930 0x7f7e440b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 -- 172.21.15.27:0/3075057991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 msgr2=0x7f7e4413ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 0x7f7e4413ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 -- 172.21.15.27:0/3075057991 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009420 con 0x7f7e4414f570 2024-01-24T12:44:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 0x7f7e4413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4a3b1640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400b400 tx=0x7f7e3400b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011830 con 0x7f7e4414f570 2024-01-24T12:44:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e44150010 con 0x7f7e4414f570 2024-01-24T12:44:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440b5520 con 0x7f7e4414f570 2024-01-24T12:44:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34011990 con 0x7f7e4414f570 2024-01-24T12:44:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011d40 con 0x7f7e4414f570 2024-01-24T12:44:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4404e000 con 0x7f7e4414f570 2024-01-24T12:44:21.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.375+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e3401a400 con 0x7f7e4414f570 2024-01-24T12:44:21.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.379+0000 7f7e3affd640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 0x7f7e30068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:21.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.379+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e34083850 con 0x7f7e4414f570 2024-01-24T12:44:21.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.379+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 0x7f7e30068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.379+0000 7f7e49bb0640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 0x7f7e30068350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e400ad000 tx=0x7f7e400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:21.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.387+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7e34051210 con 0x7f7e4414f570 2024-01-24T12:44:21.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.607+0000 7f4223729640 1 -- 172.21.15.27:0/640466267 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f421c14b190 con 0x7f421c0bec80 2024-01-24T12:44:21.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.607+0000 7f4211ffb640 1 -- 172.21.15.27:0/640466267 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f421c14b190 con 0x7f421c0bec80 2024-01-24T12:44:21.609 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2024-01-24T12:44:21.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 msgr2=0x7f4200067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 0x7f4200067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42180094a0 tx=0x7f4218009240 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 msgr2=0x7f421c14b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c14b470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f42140ac000 tx=0x7f42140196d0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 shutdown_connections 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4200065a60 0x7f4200067f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f421c0bec80 0x7f421c14b470 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f421c0b9e50 0x7f421c148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 --2- 172.21.15.27:0/640466267 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f421c06b730 0x7f421c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 >> 172.21.15.27:0/640466267 conn(0x7f421c0bcd60 msgr2=0x7f421c072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 shutdown_connections 2024-01-24T12:44:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.611+0000 7f42077fe640 1 -- 172.21.15.27:0/640466267 wait complete. 2024-01-24T12:44:21.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.615+0000 7f5dde9e5640 1 -- 172.21.15.27:0/2477676351 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5dd80b48e0 con 0x7f5dd80b7950 2024-01-24T12:44:21.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.615+0000 7f5dd4ff9640 1 -- 172.21.15.27:0/2477676351 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dd0018020 con 0x7f5dd80b7950 2024-01-24T12:44:21.615 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2024-01-24T12:44:21.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 msgr2=0x7f5dc4067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 0x7f5dc4067f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007fd0 tx=0x7f5dc8009040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 msgr2=0x7f5dd80a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0001b60 tx=0x7f5dd0002020 comp rx=0 tx=0).stop 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 shutdown_connections 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5dc4065ab0 0x7f5dc4067f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5dd81476f0 0x7f5dd8145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5dd80b7950 0x7f5dd80a0570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 --2- 172.21.15.27:0/2477676351 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5dd80b2810 0x7f5dd8148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 >> 172.21.15.27:0/2477676351 conn(0x7f5dd80bbd20 msgr2=0x7f5dd80bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 shutdown_connections 2024-01-24T12:44:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.619+0000 7f5dbe7fc640 1 -- 172.21.15.27:0/2477676351 wait complete. 2024-01-24T12:44:21.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.623+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f152c0057e0 con 0x7f15440bc6f0 2024-01-24T12:44:21.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.623+0000 7f153a7fc640 1 -- 172.21.15.27:0/679248881 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1534021020 con 0x7f15440bc6f0 2024-01-24T12:44:21.626 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2024-01-24T12:44:21.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 msgr2=0x7f1528067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 0x7f1528067fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1540007a60 tx=0x7f1540008040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 msgr2=0x7f1544141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f153400e850 tx=0x7f153400ed10 comp rx=0 tx=0).stop 2024-01-24T12:44:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 shutdown_connections 2024-01-24T12:44:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1528065ae0 0x7f1528067fa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f15440bc6f0 0x7f1544141090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f15440bc310 0x7f1544140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 --2- 172.21.15.27:0/679248881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f15440b3390 0x7f154413e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 >> 172.21.15.27:0/679248881 conn(0x7f1544069d20 msgr2=0x7f154413f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 shutdown_connections 2024-01-24T12:44:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.627+0000 7f154bae5640 1 -- 172.21.15.27:0/679248881 wait complete. 2024-01-24T12:44:21.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.639+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa3e8074100 con 0x7fa3e8144b40 2024-01-24T12:44:21.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2024-01-24T12:44:21.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.639+0000 7fa3de7fc640 1 -- 172.21.15.27:0/2551808866 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3e00ef070 con 0x7fa3e8144b40 2024-01-24T12:44:21.640 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2024-01-24T12:44:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.639+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 msgr2=0x7fa3cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 0x7fa3cc067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009890 tx=0x7fa3d8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 msgr2=0x7fa3e81ea640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3e001a5d0 tx=0x7fa3e0019740 comp rx=0 tx=0).stop 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 shutdown_connections 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa3cc065a60 0x7fa3cc067f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa3e814bd20 0x7fa3e80b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3e8144b40 0x7fa3e81ea640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 --2- 172.21.15.27:0/2551808866 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa3e806b3b0 0x7fa3e81466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 >> 172.21.15.27:0/2551808866 conn(0x7fa3e80b8770 msgr2=0x7fa3e80b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 shutdown_connections 2024-01-24T12:44:21.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.643+0000 7fa3eeaf4640 1 -- 172.21.15.27:0/2551808866 wait complete. 2024-01-24T12:44:21.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2024-01-24T12:44:21.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.655+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d5c02fed0 con 0x7f3d5c039f60 2024-01-24T12:44:21.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-01-24T12:44:21.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.655+0000 7f3d567fc640 1 -- 172.21.15.27:0/2608360901 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d600d0020 con 0x7f3d5c039f60 2024-01-24T12:44:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:21.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f040baf40 con 0x7f3f04071e50 2024-01-24T12:44:21.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3f00ff9640 1 -- 172.21.15.27:0/492961246 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3efc0551f0 con 0x7f3f04071e50 2024-01-24T12:44:21.660 INFO:teuthology.orchestra.run.smithi027.stdout:55834574854 2024-01-24T12:44:21.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 msgr2=0x7f3d48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 0x7f3d48067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d580018b0 tx=0x7f3d58009040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 msgr2=0x7f3d5c0301b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 0x7f3d5c0301b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d600b8000 tx=0x7f3d600244e0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2024-01-24T12:44:21.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 shutdown_connections 2024-01-24T12:44:21.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3d48065a60 0x7f3d48067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d5c032880 0x7f3d5c1874c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3d5c039f60 0x7f3d5c0301b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 --2- 172.21.15.27:0/2608360901 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3d5c007150 0x7f3d5c034af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 >> 172.21.15.27:0/2608360901 conn(0x7f3d5c03ee70 msgr2=0x7f3d5c005560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 shutdown_connections 2024-01-24T12:44:21.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.659+0000 7f3d6bcaa640 1 -- 172.21.15.27:0/2608360901 wait complete. 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 msgr2=0x7f3ee8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 0x7f3ee8067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00b2000 tx=0x7f3ef0009040 comp rx=0 tx=0).stop 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 msgr2=0x7f3f04149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e1a0 tx=0x7f3efc00e660 comp rx=0 tx=0).stop 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 shutdown_connections 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3ee8065a60 0x7f3ee8067f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f04147750 0x7f3f041e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3f040b4bb0 0x7f3f0414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 --2- 172.21.15.27:0/492961246 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3f04071e50 0x7f3f04149040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 >> 172.21.15.27:0/492961246 conn(0x7f3f0406a120 msgr2=0x7f3f04144130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 shutdown_connections 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f3f0a9ea640 1 -- 172.21.15.27:0/492961246 wait complete. 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f834c037e60 con 0x7f834c007260 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.663+0000 7f83517fa640 1 -- 172.21.15.27:0/2498074932 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f834000f090 con 0x7f834c007260 2024-01-24T12:44:21.665 INFO:teuthology.orchestra.run.smithi027.stdout:55834574853 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 msgr2=0x7f8338067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 0x7f8338067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ec670 tx=0x7f8348009300 comp rx=0 tx=0).stop 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 msgr2=0x7f834c0356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c0356c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83400b0000 tx=0x7f834001dc70 comp rx=0 tx=0).stop 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 shutdown_connections 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8338065a60 0x7f8338067f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f834c0ef320 0x7f834c0eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f834c03a900 0x7f834c02ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 --2- 172.21.15.27:0/2498074932 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f834c007260 0x7f834c0356c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 >> 172.21.15.27:0/2498074932 conn(0x7f834c03ef80 msgr2=0x7f834c0376b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 shutdown_connections 2024-01-24T12:44:21.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.667+0000 7f8359b32640 1 -- 172.21.15.27:0/2498074932 wait complete. 2024-01-24T12:44:21.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7e4406f590 con 0x7f7e4414f570 2024-01-24T12:44:21.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e3affd640 1 -- 172.21.15.27:0/3075057991 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e34054830 con 0x7f7e4414f570 2024-01-24T12:44:21.676 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 msgr2=0x7f7e30068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 0x7f7e30068350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e400ad000 tx=0x7f7e400a6000 comp rx=0 tx=0).stop 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 msgr2=0x7f7e440b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400b400 tx=0x7f7e3400b8c0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 shutdown_connections 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e30065e90 0x7f7e30068350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e44151930 0x7f7e440b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e44152440 0x7f7e4413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 --2- 172.21.15.27:0/3075057991 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e4414f570 0x7f7e440b4ea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:21.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 >> 172.21.15.27:0/3075057991 conn(0x7f7e44069d20 msgr2=0x7f7e4414e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:21.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 shutdown_connections 2024-01-24T12:44:21.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:21.675+0000 7f7e4c615640 1 -- 172.21.15.27:0/3075057991 wait complete. 2024-01-24T12:44:21.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2024-01-24T12:44:21.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2024-01-24T12:44:21.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-01-24T12:44:21.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-01-24T12:44:22.641 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-24T12:44:22.649 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-24T12:44:22.658 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-24T12:44:22.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-24T12:44:22.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-24T12:44:22.692 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-24T12:44:22.695 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-24T12:44:22.696 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-24T12:44:22.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 Processor -- start 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 -- start start 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5fd40b7950 0x7f5fd40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 0x7f5fd4147430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd406c7d0 con 0x7f5fd4146fe0 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40b8170 con 0x7f5fd40b7950 2024-01-24T12:44:22.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fdb814640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd406c340 con 0x7f5fd40b7d30 2024-01-24T12:44:22.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd9db1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 0x7f5fd4147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5fd40b7950 0x7f5fd40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5fd40b7950 0x7f5fd40b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52498/0 (socket says 172.21.15.27:52498) 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 -- 172.21.15.27:0/2213904782 learned_addr learned my addr 172.21.15.27:0/2213904782 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd8daf640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 -- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 msgr2=0x7f5fd4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 -- 172.21.15.27:0/2213904782 >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 msgr2=0x7f5fd4147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/2213904782 >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 0x7f5fd4147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.799+0000 7f5fd95b0640 1 -- 172.21.15.27:0/2213904782 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4147970 con 0x7f5fd40b7950 2024-01-24T12:44:22.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.803+0000 7f5fd9db1640 1 --2- 172.21.15.27:0/2213904782 >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 0x7f5fd4147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:22.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.803+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd40b2810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406df90 tx=0x7f5fcc021570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3c872a8eac3b89 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.803+0000 7f5fcbfff640 1 -- 172.21.15.27:0/2213904782 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0b4410 con 0x7f5fd40b7950 2024-01-24T12:44:22.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.803+0000 7f5fcbfff640 1 -- 172.21.15.27:0/2213904782 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0ae030 con 0x7f5fd40b7950 2024-01-24T12:44:22.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.803+0000 7f5fcbfff640 1 -- 172.21.15.27:0/2213904782 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0b4770 con 0x7f5fd40b7950 2024-01-24T12:44:22.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 msgr2=0x7f5fd40b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd40b2810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406df90 tx=0x7f5fcc021570 comp rx=0 tx=0).stop 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- 172.21.15.27:0/2213904782 shutdown_connections 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 --2- 172.21.15.27:0/2213904782 >> v2:172.21.15.27:3300/0 conn(0x7f5fd4146fe0 0x7f5fd4147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 --2- 172.21.15.27:0/2213904782 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd40b2810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- 172.21.15.27:0/2213904782 >> 172.21.15.27:0/2213904782 conn(0x7f5fd40bbd20 msgr2=0x7f5fd40bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- 172.21.15.27:0/2213904782 shutdown_connections 2024-01-24T12:44:22.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- 172.21.15.27:0/2213904782 wait complete. 2024-01-24T12:44:22.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 Processor -- start 2024-01-24T12:44:22.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 -- start start 2024-01-24T12:44:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.807+0000 7f5fdb814640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fdb814640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fdb814640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fdb814640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4140e30 con 0x7f5fd4146fe0 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fdb814640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd414a720 con 0x7f5fd40b7950 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fdb814640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4140640 con 0x7f5fd40b7d30 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd8daf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55744/0 (socket says 172.21.15.27:55744) 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 -- 172.21.15.27:0/1242540201 learned_addr learned my addr 172.21.15.27:0/1242540201 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 -- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 msgr2=0x7f5fd4140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 -- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 msgr2=0x7f5fd414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 -- 172.21.15.27:0/1242540201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc00d050 con 0x7f5fd4146fe0 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd8daf640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:22.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.811+0000 7f5fd9db1640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400e810 tx=0x7f5fc400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400c6d0 con 0x7f5fd4146fe0 2024-01-24T12:44:22.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd4142600 con 0x7f5fd4146fe0 2024-01-24T12:44:22.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd4141cb0 con 0x7f5fd4146fe0 2024-01-24T12:44:22.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400c830 con 0x7f5fd4146fe0 2024-01-24T12:44:22.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400cba0 con 0x7f5fd4146fe0 2024-01-24T12:44:22.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fc400cd00 con 0x7f5fd4146fe0 2024-01-24T12:44:22.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.815+0000 7f5fc9ffb640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 0x7f5fb8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.819+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc4082e30 con 0x7f5fd4146fe0 2024-01-24T12:44:22.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.819+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 0x7f5fb8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.819+0000 7f5fd95b0640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 0x7f5fb8067ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406df90 tx=0x7f5fcc00a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.819+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb4005260 con 0x7f5fd4146fe0 2024-01-24T12:44:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.827+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5fc4021080 con 0x7f5fd4146fe0 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 Processor -- start 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 -- start start 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f43bc071420 0x7f43bc0b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f43bc071800 0x7f43bc157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc089d40 con 0x7f43bc0a0f50 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0b7f10 con 0x7f43bc071800 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c3a43640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc06bac0 con 0x7f43bc071420 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c0fde640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f43bc071800 0x7f43bc157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c0fde640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f43bc071800 0x7f43bc157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55754/0 (socket says 172.21.15.27:55754) 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c0fde640 1 -- 172.21.15.27:0/3326888823 learned_addr learned my addr 172.21.15.27:0/3326888823 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.851+0000 7f43c17df640 1 --2- 172.21.15.27:0/3326888823 >> v2:172.21.15.124:3300/0 conn(0x7f43bc071420 0x7f43bc0b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43c0fde640 1 -- 172.21.15.27:0/3326888823 >> v2:172.21.15.124:3300/0 conn(0x7f43bc071420 msgr2=0x7f43bc0b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43c0fde640 1 --2- 172.21.15.27:0/3326888823 >> v2:172.21.15.124:3300/0 conn(0x7f43bc071420 0x7f43bc0b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43c0fde640 1 -- 172.21.15.27:0/3326888823 >> v1:172.21.15.27:6789/0 conn(0x7f43bc0a0f50 legacy=0x7f43bc15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43c0fde640 1 -- 172.21.15.27:0/3326888823 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc06bda0 con 0x7f43bc071800 2024-01-24T12:44:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43c0fde640 1 --2- 172.21.15.27:0/3326888823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc071800 0x7f43bc157590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0bcdb0 tx=0x7f43b40252f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ba262a37593832 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43b3fff640 1 -- 172.21.15.27:0/3326888823 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40b6680 con 0x7f43bc071800 2024-01-24T12:44:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43b3fff640 1 -- 172.21.15.27:0/3326888823 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b40b67e0 con 0x7f43bc071800 2024-01-24T12:44:22.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.855+0000 7f43b3fff640 1 -- 172.21.15.27:0/3326888823 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40b6b70 con 0x7f43bc071800 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- 172.21.15.27:0/3326888823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc071800 msgr2=0x7f43bc157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- 172.21.15.27:0/3326888823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc071800 0x7f43bc157590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0bcdb0 tx=0x7f43b40252f0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- 172.21.15.27:0/3326888823 shutdown_connections 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- 172.21.15.27:0/3326888823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc071800 0x7f43bc157590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- 172.21.15.27:0/3326888823 >> v2:172.21.15.124:3300/0 conn(0x7f43bc071420 0x7f43bc0b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- 172.21.15.27:0/3326888823 >> 172.21.15.27:0/3326888823 conn(0x7f43bc0bbd20 msgr2=0x7f43bc0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- 172.21.15.27:0/3326888823 shutdown_connections 2024-01-24T12:44:22.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- 172.21.15.27:0/3326888823 wait complete. 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 Processor -- start 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 Processor -- start 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 -- start start 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b78e0 0x7f5cf80a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf80a15b0 0x7f5cf8148c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80b1500 con 0x7f5cf8149150 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80b17e0 con 0x7f5cf80b78e0 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe9d0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80b1ac0 con 0x7f5cf80a15b0 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe1cf640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5cf8149150 0x7f5cf806caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40594/0 (socket says 172.21.15.27:40594) 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfe1cf640 1 -- 172.21.15.27:0/1536409844 learned_addr learned my addr 172.21.15.27:0/1536409844 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfd9ce640 1 --2- 172.21.15.27:0/1536409844 >> v2:172.21.15.124:3300/0 conn(0x7f5cf80b78e0 0x7f5cf80a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- start start 2024-01-24T12:44:22.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfd9ce640 1 -- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf80a15b0 msgr2=0x7f5cf8148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f43bc071420 0x7f43bc0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43bc071800 0x7f43bc0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc15a080 con 0x7f43bc0a0f50 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0b5440 con 0x7f43bc071800 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c3a43640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc154f40 con 0x7f43bc071420 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c1fe0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c1fe0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55762/0 (socket says 172.21.15.27:55762) 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c1fe0640 1 -- 172.21.15.27:0/892547182 learned_addr learned my addr 172.21.15.27:0/892547182 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f43c17df640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f43bc071420 0x7f43bc0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfd9ce640 1 --2- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf80a15b0 0x7f5cf8148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfd9ce640 1 -- 172.21.15.27:0/1536409844 >> v1:172.21.15.27:6789/0 conn(0x7f5cf8149150 legacy=0x7f5cf806caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.859+0000 7f5cfd9ce640 1 -- 172.21.15.27:0/1536409844 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80b7cc0 con 0x7f5cf80b78e0 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 -- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f43bc071420 msgr2=0x7f43bc0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f43bc071420 0x7f43bc0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 -- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43bc071800 msgr2=0x7f43bc0b58d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43bc071800 0x7f43bc0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 -- 172.21.15.27:0/892547182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4008a70 con 0x7f43bc0a0f50 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c1fe0640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b410 tx=0x7f43ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011830 con 0x7f43bc0a0f50 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac011990 con 0x7f43bc0a0f50 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011d40 con 0x7f43bc0a0f50 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc088d60 con 0x7f43bc0a0f50 2024-01-24T12:44:22.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc152a10 con 0x7f43bc0a0f50 2024-01-24T12:44:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f5cfd9ce640 1 --2- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf80a0af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009d90 tx=0x7f5cf001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f5136c61ca98b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0b55f0 con 0x7f43bc0a0f50 2024-01-24T12:44:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f5cfc9cc640 1 -- 172.21.15.27:0/1536409844 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00a5800 con 0x7f5cf80b78e0 2024-01-24T12:44:22.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.863+0000 7f5cfc9cc640 1 -- 172.21.15.27:0/1536409844 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf00a5960 con 0x7f5cf80b78e0 2024-01-24T12:44:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 msgr2=0x7f5cf80a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7f5cfe9d0640 1 --2- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf80a0af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009d90 tx=0x7f5cf001c800 comp rx=0 tx=0).stop 2024-01-24T12:44:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 Processor -- start 2024-01-24T12:44:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 -- start start 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 0x7fa66c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c14ec40 con 0x7fa66c0b7bb0 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0b8010 con 0x7fa66c0a11b0 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa672cf0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c14faa0 con 0x7fa66c14f0d0 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa67128d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 0x7fa66c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa670a8c640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fa66c0a11b0 0x7fa66c06b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40568/0 (socket says 172.21.15.27:40568) 2024-01-24T12:44:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa670a8c640 1 -- 172.21.15.27:0/3773264762 learned_addr learned my addr 172.21.15.27:0/3773264762 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43ac01a400 con 0x7f43bc0a0f50 2024-01-24T12:44:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa66b7fe640 1 -- 172.21.15.27:0/3773264762 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677130425 0 0) 0x7fa66c0b8010 con 0x7fa66c0a11b0 2024-01-24T12:44:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa66b7fe640 1 -- 172.21.15.27:0/3773264762 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa654003530 con 0x7fa66c0a11b0 2024-01-24T12:44:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa67128d640 1 -- 172.21.15.27:0/3773264762 >> v1:172.21.15.124:6789/0 conn(0x7fa66c0a11b0 legacy=0x7fa66c06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa67128d640 1 -- 172.21.15.27:0/3773264762 >> v1:172.21.15.27:6789/0 conn(0x7fa66c0b7bb0 legacy=0x7fa66c148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.867+0000 7fa67128d640 1 -- 172.21.15.27:0/3773264762 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06bc90 con 0x7fa66c14f0d0 2024-01-24T12:44:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7f43b1ffb640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 0x7f43a8068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43ac083160 con 0x7f43bc0a0f50 2024-01-24T12:44:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7f43c17df640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 0x7f43a8068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa67128d640 1 --2- 172.21.15.27:0/3773264762 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 0x7fa66c14f560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa664009dc0 tx=0x7fa66401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382a0ae7bfbc9bf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa66b7fe640 1 -- 172.21.15.27:0/3773264762 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640af600 con 0x7fa66c14f0d0 2024-01-24T12:44:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7f43c17df640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 0x7f43a8068180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f43b800bc10 tx=0x7f43b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa66b7fe640 1 -- 172.21.15.27:0/3773264762 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640ab050 con 0x7fa66c14f0d0 2024-01-24T12:44:22.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 -- 172.21.15.27:0/3773264762 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 msgr2=0x7fa66c14f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 --2- 172.21.15.27:0/3773264762 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 0x7fa66c14f560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa664009dc0 tx=0x7fa66401f150 comp rx=0 tx=0).stop 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 -- 172.21.15.27:0/3773264762 shutdown_connections 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 --2- 172.21.15.27:0/3773264762 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c14f0d0 0x7fa66c14f560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 -- 172.21.15.27:0/3773264762 >> 172.21.15.27:0/3773264762 conn(0x7fa66c0bbd20 msgr2=0x7fa66c0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 -- 172.21.15.27:0/3773264762 shutdown_connections 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.871+0000 7fa672cf0640 1 -- 172.21.15.27:0/3773264762 wait complete. 2024-01-24T12:44:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 Processor -- start 2024-01-24T12:44:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- start start 2024-01-24T12:44:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 0x7fa66c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 0x7fa66c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0b4220 con 0x7fa66c0a11b0 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0700f0 con 0x7fa66c14f0d0 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0b5a70 con 0x7fa66c0b7bb0 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/1536409844 shutdown_connections 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 --2- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf80a15b0 0x7f5cf8148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 --2- 172.21.15.27:0/1536409844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf80a0af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/1536409844 >> 172.21.15.27:0/1536409844 conn(0x7f5cf80b8770 msgr2=0x7f5cf80b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 0x7fa66c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa67128d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 0x7fa66c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/1536409844 shutdown_connections 2024-01-24T12:44:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55778/0 (socket says 172.21.15.27:55778) 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa67128d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 0x7fa66c0b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52548/0 (socket says 172.21.15.27:52548) 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 -- 172.21.15.27:0/169270606 learned_addr learned my addr 172.21.15.27:0/169270606 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f43bc0b55f0 con 0x7f43bc0a0f50 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 -- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 msgr2=0x7fa66c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 0x7fa66c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 -- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 msgr2=0x7fa66c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 0x7fa66c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 -- 172.21.15.27:0/169270606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009a70 con 0x7fa66c0a11b0 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa66bfff640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 0x7fa66c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa670a8c640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00c480 tx=0x7fa65c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/1536409844 wait complete. 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 Processor -- start 2024-01-24T12:44:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7f5cfe9d0640 1 -- start start 2024-01-24T12:44:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c005cf0 con 0x7fa66c0a11b0 2024-01-24T12:44:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c005e50 con 0x7fa66c0a11b0 2024-01-24T12:44:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c007290 con 0x7fa66c0a11b0 2024-01-24T12:44:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c1e3a60 con 0x7fa66c0a11b0 2024-01-24T12:44:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.875+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c070340 con 0x7fa66c0a11b0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 0x7f5cf80bb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf8149150 0x7f5cf80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80bb9b0 con 0x7f5cf80a15b0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf806f810 con 0x7f5cf80b78e0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8150660 con 0x7f5cf8149150 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd9ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 0x7f5cf80bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd9ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 0x7f5cf80bb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55786/0 (socket says 172.21.15.27:55786) 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd9ce640 1 -- 172.21.15.27:0/2987946940 learned_addr learned my addr 172.21.15.27:0/2987946940 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe1cf640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf8149150 0x7f5cf80703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 -- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf8149150 msgr2=0x7f5cf80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf8149150 0x7f5cf80703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 -- 172.21.15.27:0/2987946940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 msgr2=0x7f5cf80bb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 0x7f5cf80bb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 -- 172.21.15.27:0/2987946940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009a70 con 0x7f5cf80b78e0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfd1cd640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf806feb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b3f0 tx=0x7f5ce800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011830 con 0x7f5cf80b78e0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/2987946940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf806eee0 con 0x7f5cf80b78e0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8011990 con 0x7f5cf80b78e0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8011d40 con 0x7f5cf80b78e0 2024-01-24T12:44:22.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/2987946940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf806f4a0 con 0x7f5cf80b78e0 2024-01-24T12:44:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 Processor -- start 2024-01-24T12:44:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 -- start start 2024-01-24T12:44:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/2987946940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf8066e40 con 0x7f5cf80b78e0 2024-01-24T12:44:22.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2d60071420 0x7f2d600b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d600a0f50 0x7f2d60161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d60089d40 con 0x7f2d60071800 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa65c0073f0 con 0x7fa66c0a11b0 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7fa6697fa640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 0x7fa658067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa65c0827d0 con 0x7fa66c0a11b0 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7fa66bfff640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 0x7fa658067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ce801a400 con 0x7f5cf80b78e0 2024-01-24T12:44:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7fa66bfff640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 0x7fa658067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa66c145200 tx=0x7fa660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f5cee7fc640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 0x7f5cdc067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce8083830 con 0x7f5cf80b78e0 2024-01-24T12:44:22.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f5cfd9ce640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 0x7f5cdc067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f5cfd9ce640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 0x7f5cdc067ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000f90 tx=0x7f5cf00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d60157ca0 con 0x7f2d60071420 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d67887640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600b7f10 con 0x7f2d600a0f50 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d600a0f50 0x7f2d60161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2d600a0f50 0x7f2d60161dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:52574/0 (socket says 172.21.15.27:52574) 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 -- 172.21.15.27:0/2445602796 learned_addr learned my addr 172.21.15.27:0/2445602796 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 -- 172.21.15.27:0/2445602796 >> v2:172.21.15.27:3300/0 conn(0x7f2d60071420 msgr2=0x7f2d600b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 --2- 172.21.15.27:0/2445602796 >> v2:172.21.15.27:3300/0 conn(0x7f2d60071420 0x7f2d600b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 -- 172.21.15.27:0/2445602796 >> v1:172.21.15.124:6789/0 conn(0x7f2d60071800 legacy=0x7f2d60157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.879+0000 7f2d65e24640 1 -- 172.21.15.27:0/2445602796 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6006bac0 con 0x7f2d600a0f50 2024-01-24T12:44:22.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7f2d65e24640 1 --2- 172.21.15.27:0/2445602796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d600a0f50 0x7f2d60161dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d6006b260 tx=0x7f2d580251b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1de8b0bab9edbc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.883+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c005260 con 0x7fa66c0a11b0 2024-01-24T12:44:22.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.891+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa65c017080 con 0x7fa66c0a11b0 2024-01-24T12:44:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5ce8051200 con 0x7f5cf80b78e0 2024-01-24T12:44:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d57fff640 1 -- 172.21.15.27:0/2445602796 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580b6410 con 0x7f2d600a0f50 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d57fff640 1 -- 172.21.15.27:0/2445602796 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580b0030 con 0x7f2d600a0f50 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d57fff640 1 -- 172.21.15.27:0/2445602796 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580b6790 con 0x7f2d600a0f50 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- 172.21.15.27:0/2445602796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d600a0f50 msgr2=0x7f2d60161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 --2- 172.21.15.27:0/2445602796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d600a0f50 0x7f2d60161dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d6006b260 tx=0x7f2d580251b0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- 172.21.15.27:0/2445602796 shutdown_connections 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 --2- 172.21.15.27:0/2445602796 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d600a0f50 0x7f2d60161dc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 --2- 172.21.15.27:0/2445602796 >> v2:172.21.15.27:3300/0 conn(0x7f2d60071420 0x7f2d600b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- 172.21.15.27:0/2445602796 >> 172.21.15.27:0/2445602796 conn(0x7f2d600bbd20 msgr2=0x7f2d600bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- 172.21.15.27:0/2445602796 shutdown_connections 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- 172.21.15.27:0/2445602796 wait complete. 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 Processor -- start 2024-01-24T12:44:22.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.895+0000 7f2d67887640 1 -- start start 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d60071420 0x7f2d6015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d60071800 0x7f2d600b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600b61c0 con 0x7f2d600a0f50 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6015b3d0 con 0x7f2d60071800 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600b39c0 con 0x7f2d60071420 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55808/0 (socket says 172.21.15.27:55808) 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 -- 172.21.15.27:0/1166016973 learned_addr learned my addr 172.21.15.27:0/1166016973 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d64e22640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d60071800 0x7f2d600b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65623640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d60071420 0x7f2d6015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 -- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d60071420 msgr2=0x7f2d6015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d60071420 0x7f2d6015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 -- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d60071800 msgr2=0x7f2d600b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d60071800 0x7f2d600b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 -- 172.21.15.27:0/1166016973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58005fb0 con 0x7f2d600a0f50 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d65e24640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d58022de0 tx=0x7f2d58021f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580b6de0 con 0x7f2d600a0f50 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d600b5ee0 con 0x7f2d600a0f50 2024-01-24T12:44:22.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d600b5be0 con 0x7f2d600a0f50 2024-01-24T12:44:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580c0470 con 0x7f2d600a0f50 2024-01-24T12:44:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580c0800 con 0x7f2d600a0f50 2024-01-24T12:44:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.899+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d40005260 con 0x7f2d600a0f50 2024-01-24T12:44:22.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.903+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d580bd040 con 0x7f2d600a0f50 2024-01-24T12:44:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.903+0000 7f2d55ffb640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 0x7f2d44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.903+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d58126f20 con 0x7f2d600a0f50 2024-01-24T12:44:22.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.903+0000 7f2d65623640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 0x7f2d44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.903+0000 7f2d65623640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 0x7f2d44067f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009990 tx=0x7f2d5c009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2d580f4b60 con 0x7f2d600a0f50 2024-01-24T12:44:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 Processor -- start 2024-01-24T12:44:22.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 -- start start 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2b50007150 0x7f2b50035f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2b500c8f70 0x7f2b500d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b50036550 con 0x7f2b50038810 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b50038ca0 con 0x7f2b50007150 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5d54f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b50036830 con 0x7f2b500c8f70 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b577fe640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f2b50038810 0x7f2b500c8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40588/0 (socket says 172.21.15.27:40588) 2024-01-24T12:44:22.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b577fe640 1 -- 172.21.15.27:0/1291786923 learned_addr learned my addr 172.21.15.27:0/1291786923 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5cd4e640 1 --2- 172.21.15.27:0/1291786923 >> v2:172.21.15.124:3300/0 conn(0x7f2b500c8f70 0x7f2b500d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b56ffd640 1 -- 172.21.15.27:0/1291786923 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584811260 0 0) 0x7f2b50036550 con 0x7f2b50038810 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b56ffd640 1 -- 172.21.15.27:0/1291786923 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003530 con 0x7f2b50038810 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5cd4e640 1 -- 172.21.15.27:0/1291786923 >> v2:172.21.15.27:3300/0 conn(0x7f2b50007150 msgr2=0x7f2b50035f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5cd4e640 1 --2- 172.21.15.27:0/1291786923 >> v2:172.21.15.27:3300/0 conn(0x7f2b50007150 0x7f2b50035f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5cd4e640 1 -- 172.21.15.27:0/1291786923 >> v1:172.21.15.124:6789/0 conn(0x7f2b50038810 legacy=0x7f2b500c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.911+0000 7f2b5cd4e640 1 -- 172.21.15.27:0/1291786923 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50036b10 con 0x7f2b500c8f70 2024-01-24T12:44:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.915+0000 7f2b5cd4e640 1 --2- 172.21.15.27:0/1291786923 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b500c8f70 0x7f2b500d2380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b58074440 tx=0x7f2b58096470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b203e5a2f3a58de8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.915+0000 7f2b56ffd640 1 -- 172.21.15.27:0/1291786923 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58125600 con 0x7f2b500c8f70 2024-01-24T12:44:22.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.915+0000 7f2b56ffd640 1 -- 172.21.15.27:0/1291786923 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58121050 con 0x7f2b500c8f70 2024-01-24T12:44:22.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.915+0000 7f2b56ffd640 1 -- 172.21.15.27:0/1291786923 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58125a60 con 0x7f2b500c8f70 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- 172.21.15.27:0/1291786923 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b500c8f70 msgr2=0x7f2b500d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/1291786923 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b500c8f70 0x7f2b500d2380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b58074440 tx=0x7f2b58096470 comp rx=0 tx=0).stop 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- 172.21.15.27:0/1291786923 shutdown_connections 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/1291786923 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b500c8f70 0x7f2b500d2380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/1291786923 >> v2:172.21.15.27:3300/0 conn(0x7f2b50007150 0x7f2b50035f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- 172.21.15.27:0/1291786923 >> 172.21.15.27:0/1291786923 conn(0x7f2b5003ee70 msgr2=0x7f2b5003f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- 172.21.15.27:0/1291786923 shutdown_connections 2024-01-24T12:44:22.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- 172.21.15.27:0/1291786923 wait complete. 2024-01-24T12:44:22.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 Processor -- start 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- start start 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b50038810 0x7f2b50027df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b500c8f70 0x7f2b500c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50040e40 con 0x7f2b50007150 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5003b620 con 0x7f2b50038810 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b5d54f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500d3ad0 con 0x7f2b500c8f70 2024-01-24T12:44:22.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.919+0000 7f2b577fe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b50038810 0x7f2b50027df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55826/0 (socket says 172.21.15.27:55826) 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 -- 172.21.15.27:0/3446050605 learned_addr learned my addr 172.21.15.27:0/3446050605 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b5cd4e640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b500c8f70 0x7f2b500c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 -- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b500c8f70 msgr2=0x7f2b500c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b500c8f70 0x7f2b500c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 -- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b50038810 msgr2=0x7f2b50027df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b50038810 0x7f2b50027df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 -- 172.21.15.27:0/3446050605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500d4d50 con 0x7f2b50007150 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b57fff640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400b550 tx=0x7f2b4400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44010610 con 0x7f2b50007150 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44010790 con 0x7f2b50007150 2024-01-24T12:44:22.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44010b40 con 0x7f2b50007150 2024-01-24T12:44:22.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500d6eb0 con 0x7f2b50007150 2024-01-24T12:44:22.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b500cf030 con 0x7f2b50007150 2024-01-24T12:44:22.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.923+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b500cecb0 con 0x7f2b50007150 2024-01-24T12:44:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 Processor -- start 2024-01-24T12:44:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 -- start start 2024-01-24T12:44:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 Processor -- start 2024-01-24T12:44:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60152f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5dd9b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efd6006fbe0 0x7efd600709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40616/0 (socket says 172.21.15.27:40616) 2024-01-24T12:44:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5dd9b640 1 -- 172.21.15.27:0/2269352826 learned_addr learned my addr 172.21.15.27:0/2269352826 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:22.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600b7260 con 0x7efd6006fbe0 2024-01-24T12:44:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 -- start start 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea380b7190 0x7fea38159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea38152be0 con 0x7fea38069f80 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea38070d00 con 0x7fea380b7190 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea40324640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3814fe80 con 0x7fea38071a90 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:54006/0 (socket says 172.21.15.27:54006) 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 -- 172.21.15.27:0/2808381919 learned_addr learned my addr 172.21.15.27:0/2808381919 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3e8c1640 1 --2- 172.21.15.27:0/2808381919 >> v2:172.21.15.124:3300/0 conn(0x7fea380b7190 0x7fea38159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5ed9d640 1 --2- 172.21.15.27:0/2269352826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd60070510 con 0x7efd6014aeb0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6014bba0 con 0x7efd600710b0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5d59a640 1 -- 172.21.15.27:0/2269352826 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314825320 0 0) 0x7efd60070510 con 0x7efd6014aeb0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5d59a640 1 -- 172.21.15.27:0/2269352826 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd48003530 con 0x7efd6014aeb0 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5ed9d640 1 -- 172.21.15.27:0/2269352826 >> v1:172.21.15.124:6789/0 conn(0x7efd6014aeb0 legacy=0x7efd600b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b44010ca0 con 0x7f2b50007150 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7f2b54ff9640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 0x7f2b3c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b44083110 con 0x7f2b50007150 2024-01-24T12:44:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7efd5ed9d640 1 -- 172.21.15.27:0/2269352826 >> v1:172.21.15.27:6789/0 conn(0x7efd6006fbe0 legacy=0x7efd600709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7efd5ed9d640 1 -- 172.21.15.27:0/2269352826 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6014b5e0 con 0x7efd600710b0 2024-01-24T12:44:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7f2b577fe640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 0x7f2b3c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7f2b577fe640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 0x7f2b3c067f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b500d4680 tx=0x7f2b4c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 -- 172.21.15.27:0/2808381919 >> v2:172.21.15.124:3300/0 conn(0x7fea380b7190 msgr2=0x7fea38159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 --2- 172.21.15.27:0/2808381919 >> v2:172.21.15.124:3300/0 conn(0x7fea380b7190 0x7fea38159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 -- 172.21.15.27:0/2808381919 >> v1:172.21.15.27:6789/0 conn(0x7fea38069f80 legacy=0x7fea3814eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.931+0000 7fea3d8bf640 1 -- 172.21.15.27:0/2808381919 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38070630 con 0x7fea38071a90 2024-01-24T12:44:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7fea3d8bf640 1 --2- 172.21.15.27:0/2808381919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e50 tx=0x7fea3001c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6fdaa4a737ac60d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2b44050bf0 con 0x7f2b50007150 2024-01-24T12:44:22.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7efd5ed9d640 1 --2- 172.21.15.27:0/2269352826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60152f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd5800f3a0 tx=0x7efd58020d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24017f6d2ca444bd server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7fea3d0be640 1 -- 172.21.15.27:0/2808381919 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300a5780 con 0x7fea38071a90 2024-01-24T12:44:22.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7efd5d59a640 1 -- 172.21.15.27:0/2269352826 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd580a9d30 con 0x7efd600710b0 2024-01-24T12:44:22.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7efd5d59a640 1 -- 172.21.15.27:0/2269352826 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd580a9e90 con 0x7efd600710b0 2024-01-24T12:44:22.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7efd5d59a640 1 -- 172.21.15.27:0/2269352826 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800d2f0 con 0x7efd600710b0 2024-01-24T12:44:22.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.935+0000 7fea3d0be640 1 -- 172.21.15.27:0/2808381919 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300a58e0 con 0x7fea38071a90 2024-01-24T12:44:22.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 msgr2=0x7efd60152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 --2- 172.21.15.27:0/2269352826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60152f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd5800f3a0 tx=0x7efd58020d40 comp rx=0 tx=0).stop 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 shutdown_connections 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 --2- 172.21.15.27:0/2269352826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60152f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 >> 172.21.15.27:0/2269352826 conn(0x7efd600b98f0 msgr2=0x7efd600b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 -- 172.21.15.27:0/2808381919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 msgr2=0x7fea38148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 --2- 172.21.15.27:0/2808381919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e50 tx=0x7fea3001c9f0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 shutdown_connections 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- 172.21.15.27:0/2269352826 wait complete. 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 -- 172.21.15.27:0/2808381919 shutdown_connections 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 --2- 172.21.15.27:0/2808381919 >> v2:172.21.15.124:3300/0 conn(0x7fea380b7190 0x7fea38159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 --2- 172.21.15.27:0/2808381919 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea38071a90 0x7fea38148e50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7fea40324640 1 -- 172.21.15.27:0/2808381919 >> 172.21.15.27:0/2808381919 conn(0x7fea3806ae30 msgr2=0x7fea3806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:22.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 Processor -- start 2024-01-24T12:44:22.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.939+0000 7efd5f59e640 1 -- start start 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd60142050 0x7efd601df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5e59c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55828/0 (socket says 172.21.15.27:55828) 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5e59c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:54010/0 (socket says 172.21.15.27:54010) 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 -- 172.21.15.27:0/4192490737 learned_addr learned my addr 172.21.15.27:0/4192490737 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60143aa0 con 0x7efd6014aeb0 2024-01-24T12:44:22.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd601de660 con 0x7efd60142050 2024-01-24T12:44:22.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd60143c90 con 0x7efd600710b0 2024-01-24T12:44:22.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5ed9d640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd60142050 0x7efd601df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 -- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 msgr2=0x7efd60143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 -- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd60142050 msgr2=0x7efd601df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd60142050 0x7efd601df060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5800f050 con 0x7efd6014aeb0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5dd9b640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50005cf0 con 0x7efd6014aeb0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50005e50 con 0x7efd6014aeb0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500072d0 con 0x7efd6014aeb0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6006d480 con 0x7efd6014aeb0 2024-01-24T12:44:22.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6006d760 con 0x7efd6014aeb0 2024-01-24T12:44:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.943+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd601de820 con 0x7efd6014aeb0 2024-01-24T12:44:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- 172.21.15.27:0/2808381919 shutdown_connections 2024-01-24T12:44:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd50007430 con 0x7efd6014aeb0 2024-01-24T12:44:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7efd4effd640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 0x7efd40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd50082e60 con 0x7efd6014aeb0 2024-01-24T12:44:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7efd5e59c640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 0x7efd40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- 172.21.15.27:0/2808381919 wait complete. 2024-01-24T12:44:22.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 Processor -- start 2024-01-24T12:44:22.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- start start 2024-01-24T12:44:22.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7efd5e59c640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 0x7efd40067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd540011f0 tx=0x7efd54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea38071a90 0x7fea38142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea380b7190 0x7fea38148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38147950 con 0x7fea38069f80 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38140ff0 con 0x7fea38071a90 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea40324640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea38141740 con 0x7fea380b7190 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea3e0c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea3e0c0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55844/0 (socket says 172.21.15.27:55844) 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.947+0000 7fea3e0c0640 1 -- 172.21.15.27:0/2666079618 learned_addr learned my addr 172.21.15.27:0/2666079618 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e8c1640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea380b7190 0x7fea38148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3d8bf640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea38071a90 0x7fea38142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 -- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea380b7190 msgr2=0x7fea38148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea380b7190 0x7fea38148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 -- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea38071a90 msgr2=0x7fea38142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea38071a90 0x7fea38142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 -- 172.21.15.27:0/2666079618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009b30 con 0x7fea38069f80 2024-01-24T12:44:22.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.951+0000 7fea3e0c0640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c450 tx=0x7fea3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.963+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34012830 con 0x7fea38069f80 2024-01-24T12:44:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.963+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efd500ae0b0 con 0x7efd6014aeb0 2024-01-24T12:44:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.967+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea381458b0 con 0x7fea38069f80 2024-01-24T12:44:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.967+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea381400b0 con 0x7fea38069f80 2024-01-24T12:44:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.967+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea340129b0 con 0x7fea38069f80 2024-01-24T12:44:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.967+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34012d60 con 0x7fea38069f80 2024-01-24T12:44:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea3401c460 con 0x7fea38069f80 2024-01-24T12:44:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea2effd640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 0x7fea240680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea3d8bf640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 0x7fea240680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea340545b0 con 0x7fea38069f80 2024-01-24T12:44:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea20005260 con 0x7fea38069f80 2024-01-24T12:44:22.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.971+0000 7fea3d8bf640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 0x7fea240680e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fea300ae000 tx=0x7fea300a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:22.979+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fea340508f0 con 0x7fea38069f80 2024-01-24T12:44:23.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.163+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f43bc0b55f0 con 0x7f43bc0a0f50 2024-01-24T12:44:23.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.163+0000 7f43b1ffb640 1 -- 172.21.15.27:0/892547182 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43bc0b55f0 con 0x7f43bc0a0f50 2024-01-24T12:44:23.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.167+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5fb4005510 con 0x7f5fd4146fe0 2024-01-24T12:44:23.168 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:23.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.167+0000 7f5fc9ffb640 1 -- 172.21.15.27:0/1242540201 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fc4050910 con 0x7f5fd4146fe0 2024-01-24T12:44:23.170 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 msgr2=0x7f5fb8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 0x7f5fb8067ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5fd406df90 tx=0x7f5fcc00a040 comp rx=0 tx=0).stop 2024-01-24T12:44:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 msgr2=0x7f5fd40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400e810 tx=0x7f5fc400ecd0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 msgr2=0x7f43a8068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 shutdown_connections 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5fb8065b30 0x7f5fb8067ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fd4146fe0 0x7f5fd40b31c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5fd40b7d30 0x7f5fd4140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 --2- 172.21.15.27:0/1242540201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5fd40b7950 0x7f5fd414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 >> 172.21.15.27:0/1242540201 conn(0x7f5fd40bbd20 msgr2=0x7f5fd40b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 0x7f43a8068180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f43b800bc10 tx=0x7f43b8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:23.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 shutdown_connections 2024-01-24T12:44:23.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f5fdb814640 1 -- 172.21.15.27:0/1242540201 wait complete. 2024-01-24T12:44:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 msgr2=0x7f43bc159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00b410 tx=0x7f43ac00b8d0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 shutdown_connections 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f43a8065cc0 0x7f43a8068180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43bc0a0f50 0x7f43bc159b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43bc071800 0x7f43bc0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 --2- 172.21.15.27:0/892547182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f43bc071420 0x7f43bc0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 >> 172.21.15.27:0/892547182 conn(0x7f43bc0bbd20 msgr2=0x7f43bc06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 shutdown_connections 2024-01-24T12:44:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.171+0000 7f43c3a43640 1 -- 172.21.15.27:0/892547182 wait complete. 2024-01-24T12:44:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.183+0000 7f5cfe9d0640 1 -- 172.21.15.27:0/2987946940 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5cf8146fa0 con 0x7f5cf80b78e0 2024-01-24T12:44:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.183+0000 7f5cee7fc640 1 -- 172.21.15.27:0/2987946940 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ce8015090 con 0x7f5cf80b78e0 2024-01-24T12:44:23.184 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 msgr2=0x7f5cdc067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 0x7f5cdc067ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0000f90 tx=0x7f5cf00a7070 comp rx=0 tx=0).stop 2024-01-24T12:44:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 msgr2=0x7f5cf806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf806feb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b3f0 tx=0x7f5ce800b8b0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 shutdown_connections 2024-01-24T12:44:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5cdc065a30 0x7f5cdc067ef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5cf8149150 0x7f5cf80703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5cf80b78e0 0x7f5cf806feb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 --2- 172.21.15.27:0/2987946940 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5cf80a15b0 0x7f5cf80bb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.187+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 >> 172.21.15.27:0/2987946940 conn(0x7f5cf80b8770 msgr2=0x7f5cf8146890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.191+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 shutdown_connections 2024-01-24T12:44:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.191+0000 7f5cdbfff640 1 -- 172.21.15.27:0/2987946940 wait complete. 2024-01-24T12:44:23.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-01-24T12:44:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.195+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa64c005510 con 0x7fa66c0a11b0 2024-01-24T12:44:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.195+0000 7fa6697fa640 1 -- 172.21.15.27:0/169270606 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa65c0501a0 con 0x7fa66c0a11b0 2024-01-24T12:44:23.199 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.199 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:23.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-01-24T12:44:23.200 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 msgr2=0x7fa658067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 0x7fa658067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa66c145200 tx=0x7fa660009040 comp rx=0 tx=0).stop 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 msgr2=0x7fa66c0b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00c480 tx=0x7fa65c00c940 comp rx=0 tx=0).stop 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 shutdown_connections 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa658065a60 0x7fa658067f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa66c14f0d0 0x7fa66c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa66c0b7bb0 0x7fa66c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 --2- 172.21.15.27:0/169270606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa66c0a11b0 0x7fa66c0b30e0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00c480 tx=0x7fa65c00c940 comp rx=0 tx=0).stop 2024-01-24T12:44:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 >> 172.21.15.27:0/169270606 conn(0x7fa66c0bbd20 msgr2=0x7fa66c147f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 shutdown_connections 2024-01-24T12:44:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.199+0000 7fa672cf0640 1 -- 172.21.15.27:0/169270606 wait complete. 2024-01-24T12:44:23.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-01-24T12:44:23.216 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-01-24T12:44:23.226 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.227+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d400057e0 con 0x7f2d600a0f50 2024-01-24T12:44:23.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.227+0000 7f2d55ffb640 1 -- 172.21.15.27:0/1166016973 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d580bb020 con 0x7f2d600a0f50 2024-01-24T12:44:23.230 INFO:teuthology.orchestra.run.smithi027.stdout:55834574856 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 msgr2=0x7f2d44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 0x7f2d44067f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009990 tx=0x7f2d5c009110 comp rx=0 tx=0).stop 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 msgr2=0x7f2d600b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d58022de0 tx=0x7f2d58021f50 comp rx=0 tx=0).stop 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 shutdown_connections 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d44065a60 0x7f2d44067f20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d600a0f50 0x7f2d600b4960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d60071800 0x7f2d600b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 --2- 172.21.15.27:0/1166016973 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d60071420 0x7f2d6015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 >> 172.21.15.27:0/1166016973 conn(0x7f2d600bbd20 msgr2=0x7f2d600b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 shutdown_connections 2024-01-24T12:44:23.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.231+0000 7f2d67887640 1 -- 172.21.15.27:0/1166016973 wait complete. 2024-01-24T12:44:23.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2b50005350 con 0x7f2b50007150 2024-01-24T12:44:23.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b54ff9640 1 -- 172.21.15.27:0/3446050605 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b44014090 con 0x7f2b50007150 2024-01-24T12:44:23.236 INFO:teuthology.orchestra.run.smithi027.stdout:55834574855 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 msgr2=0x7f2b3c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 0x7f2b3c067f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b500d4680 tx=0x7f2b4c007d40 comp rx=0 tx=0).stop 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 msgr2=0x7f2b5003b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400b550 tx=0x7f2b4400ba10 comp rx=0 tx=0).stop 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 shutdown_connections 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2b3c065ab0 0x7f2b3c067f70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2b500c8f70 0x7f2b500c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2b50038810 0x7f2b50027df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 --2- 172.21.15.27:0/3446050605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2b50007150 0x7f2b5003b0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 >> 172.21.15.27:0/3446050605 conn(0x7f2b5003ee70 msgr2=0x7f2b500419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 shutdown_connections 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.235+0000 7f2b5d54f640 1 -- 172.21.15.27:0/3446050605 wait complete. 2024-01-24T12:44:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efd600b3d10 con 0x7efd6014aeb0 2024-01-24T12:44:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd4effd640 1 -- 172.21.15.27:0/4192490737 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd50021090 con 0x7efd6014aeb0 2024-01-24T12:44:23.240 INFO:teuthology.orchestra.run.smithi027.stdout:55834574857 2024-01-24T12:44:23.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 msgr2=0x7efd40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 0x7efd40067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd540011f0 tx=0x7efd54009040 comp rx=0 tx=0).stop 2024-01-24T12:44:23.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 msgr2=0x7efd601deb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 shutdown_connections 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd40065a60 0x7efd40067f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd60142050 0x7efd601df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd6014aeb0 0x7efd601deb20 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 --2- 172.21.15.27:0/4192490737 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd600710b0 0x7efd60143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 >> 172.21.15.27:0/4192490737 conn(0x7efd600b98f0 msgr2=0x7efd600bb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 shutdown_connections 2024-01-24T12:44:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.239+0000 7efd5f59e640 1 -- 172.21.15.27:0/4192490737 wait complete. 2024-01-24T12:44:23.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.247+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea200057e0 con 0x7fea38069f80 2024-01-24T12:44:23.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.247+0000 7fea2effd640 1 -- 172.21.15.27:0/2666079618 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea34053f10 con 0x7fea38069f80 2024-01-24T12:44:23.250 INFO:teuthology.orchestra.run.smithi027.stdout:55834574857 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 msgr2=0x7fea240680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 0x7fea240680e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fea300ae000 tx=0x7fea300a7070 comp rx=0 tx=0).stop 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 msgr2=0x7fea38147410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c450 tx=0x7fea3400c910 comp rx=0 tx=0).stop 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 shutdown_connections 2024-01-24T12:44:23.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea24065c20 0x7fea240680e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea380b7190 0x7fea38148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea38071a90 0x7fea38142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 --2- 172.21.15.27:0/2666079618 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea38069f80 0x7fea38147410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 >> 172.21.15.27:0/2666079618 conn(0x7fea3806ae30 msgr2=0x7fea380bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-01-24T12:44:23.253 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 shutdown_connections 2024-01-24T12:44:23.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.251+0000 7fea40324640 1 -- 172.21.15.27:0/2666079618 wait complete. 2024-01-24T12:44:23.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-01-24T12:44:23.258 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-01-24T12:44:23.263 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-01-24T12:44:23.269 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:23.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-24T12:44:23.269 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:23.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.419+0000 7f7e7b001640 1 Processor -- start 2024-01-24T12:44:23.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.419+0000 7f7e7b001640 1 -- start start 2024-01-24T12:44:23.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e740708d0 0x7f7e74070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7e74071a20 0x7f7e74147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b2c80 con 0x7f7e7406eca0 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7406fdb0 con 0x7f7e740708d0 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e74070370 con 0x7f7e74071a20 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e740708d0 0x7f7e74070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7e740708d0 0x7f7e74070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55846/0 (socket says 172.21.15.27:55846) 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 -- 172.21.15.27:0/2362247322 learned_addr learned my addr 172.21.15.27:0/2362247322 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e73fff640 1 --2- 172.21.15.27:0/2362247322 >> v2:172.21.15.124:3300/0 conn(0x7f7e74071a20 0x7f7e74147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 -- 172.21.15.27:0/2362247322 >> v2:172.21.15.124:3300/0 conn(0x7f7e74071a20 msgr2=0x7f7e74147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:23.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 --2- 172.21.15.27:0/2362247322 >> v2:172.21.15.124:3300/0 conn(0x7f7e74071a20 0x7f7e74147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 -- 172.21.15.27:0/2362247322 >> v1:172.21.15.124:6789/0 conn(0x7f7e7406eca0 legacy=0x7f7e741440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:23.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 -- 172.21.15.27:0/2362247322 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740b2ed0 con 0x7f7e740708d0 2024-01-24T12:44:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e78d9d640 1 --2- 172.21.15.27:0/2362247322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e740708d0 0x7f7e74070cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e7406d230 tx=0x7f7e6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83abea0708a99c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e737fe640 1 -- 172.21.15.27:0/2362247322 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640ab600 con 0x7f7e740708d0 2024-01-24T12:44:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e737fe640 1 -- 172.21.15.27:0/2362247322 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640a7050 con 0x7f7e740708d0 2024-01-24T12:44:23.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e737fe640 1 -- 172.21.15.27:0/2362247322 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640ab980 con 0x7f7e740708d0 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 -- 172.21.15.27:0/2362247322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e740708d0 msgr2=0x7f7e74070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.423+0000 7f7e7b001640 1 --2- 172.21.15.27:0/2362247322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e740708d0 0x7f7e74070cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e7406d230 tx=0x7f7e6401c4d0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/2362247322 shutdown_connections 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 --2- 172.21.15.27:0/2362247322 >> v2:172.21.15.124:3300/0 conn(0x7f7e74071a20 0x7f7e74147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 --2- 172.21.15.27:0/2362247322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e740708d0 0x7f7e74070cb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/2362247322 >> 172.21.15.27:0/2362247322 conn(0x7f7e74069ef0 msgr2=0x7f7e7406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/2362247322 shutdown_connections 2024-01-24T12:44:23.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/2362247322 wait complete. 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 Processor -- start 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- start start 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e74071a20 0x7f7e741e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 0x7f7e740bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740bb510 con 0x7f7e7406eca0 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741e4bc0 con 0x7f7e74071a20 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741e4ea0 con 0x7f7e740b3fe0 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55848/0 (socket says 172.21.15.27:55848) 2024-01-24T12:44:23.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 -- 172.21.15.27:0/3291031273 learned_addr learned my addr 172.21.15.27:0/3291031273 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7959e640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 0x7f7e740bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e73fff640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e74071a20 0x7f7e741e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 -- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 msgr2=0x7f7e740bafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 0x7f7e740bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 -- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e74071a20 msgr2=0x7f7e741e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e74071a20 0x7f7e741e15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 -- 172.21.15.27:0/3291031273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640094d0 con 0x7f7e7406eca0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7959e640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 0x7f7e740bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e78d9d640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ae040 tx=0x7f7e64019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640b4840 con 0x7f7e7406eca0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640b49c0 con 0x7f7e7406eca0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e741e5180 con 0x7f7e7406eca0 2024-01-24T12:44:23.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640b4d70 con 0x7f7e7406eca0 2024-01-24T12:44:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740bb7c0 con 0x7f7e7406eca0 2024-01-24T12:44:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.427+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7404e000 con 0x7f7e7406eca0 2024-01-24T12:44:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e640b2040 con 0x7f7e7406eca0 2024-01-24T12:44:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e717fa640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 0x7f7e60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e6411c930 con 0x7f7e7406eca0 2024-01-24T12:44:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e73fff640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 0x7f7e60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e73fff640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 0x7f7e60067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e7413ce40 tx=0x7f7e68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.431+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7e640ea480 con 0x7f7e7406eca0 2024-01-24T12:44:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.579+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e741e4d30 con 0x7f7e60065a60 2024-01-24T12:44:23.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.599+0000 7f7e717fa640 1 -- 172.21.15.27:0/3291031273 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264412 (secure 0 0 0) 0x7f7e741e4d30 con 0x7f7e60065a60 2024-01-24T12:44:23.601 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:23.603 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:23.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 msgr2=0x7f7e60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 0x7f7e60067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e7413ce40 tx=0x7f7e68008040 comp rx=0 tx=0).stop 2024-01-24T12:44:23.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 msgr2=0x7f7e741e56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ae040 tx=0x7f7e64019270 comp rx=0 tx=0).stop 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 shutdown_connections 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7e60065a60 0x7f7e60067f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7e740b3fe0 0x7f7e740bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7e74071a20 0x7f7e741e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 --2- 172.21.15.27:0/3291031273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7406eca0 0x7f7e741e56a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 >> 172.21.15.27:0/3291031273 conn(0x7f7e74069ef0 msgr2=0x7f7e74145470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 shutdown_connections 2024-01-24T12:44:23.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.603+0000 7f7e7b001640 1 -- 172.21.15.27:0/3291031273 wait complete. 2024-01-24T12:44:23.619 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-24T12:44:21.623580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003327"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310364+0000","last_change":"2024-01-24T12:44:11.346047+0000","last_active":"2024-01-24T12:44:12.310364+0000","last_peered":"2024-01-24T12:44:12.310364+0000","last_clean":"2024-01-24T12:44:12.310364+0000","last_became_active":"2024-01-24T12:44:11.345291+0000","last_became_peered":"2024-01-24T12:44:11.345291+0000","last_unstale":"2024-01-24T12:44:12.310364+0000","last_undegraded":"2024-01-24T12:44:12.310364+0000","last_fullsized":"2024-01-24T12:44:12.310364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308731+0000","last_change":"2024-01-24T12:44:11.311127+0000","last_active":"2024-01-24T12:44:12.308731+0000","last_peered":"2024-01-24T12:44:12.308731+0000","last_clean":"2024-01-24T12:44:12.308731+0000","last_became_active":"2024-01-24T12:44:11.310860+0000","last_became_peered":"2024-01-24T12:44:11.310860+0000","last_unstale":"2024-01-24T12:44:12.308731+0000","last_undegraded":"2024-01-24T12:44:12.308731+0000","last_fullsized":"2024-01-24T12:44:12.308731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306766+0000","last_change":"2024-01-24T12:44:11.304106+0000","last_active":"2024-01-24T12:44:12.306766+0000","last_peered":"2024-01-24T12:44:12.306766+0000","last_clean":"2024-01-24T12:44:12.306766+0000","last_became_active":"2024-01-24T12:44:11.303766+0000","last_became_peered":"2024-01-24T12:44:11.303766+0000","last_unstale":"2024-01-24T12:44:12.306766+0000","last_undegraded":"2024-01-24T12:44:12.306766+0000","last_fullsized":"2024-01-24T12:44:12.306766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308433+0000","last_change":"2024-01-24T12:44:11.344843+0000","last_active":"2024-01-24T12:44:12.308433+0000","last_peered":"2024-01-24T12:44:12.308433+0000","last_clean":"2024-01-24T12:44:12.308433+0000","last_became_active":"2024-01-24T12:44:11.342895+0000","last_became_peered":"2024-01-24T12:44:11.342895+0000","last_unstale":"2024-01-24T12:44:12.308433+0000","last_undegraded":"2024-01-24T12:44:12.308433+0000","last_fullsized":"2024-01-24T12:44:12.308433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309684+0000","last_change":"2024-01-24T12:44:11.350959+0000","last_active":"2024-01-24T12:44:12.309684+0000","last_peered":"2024-01-24T12:44:12.309684+0000","last_clean":"2024-01-24T12:44:12.309684+0000","last_became_active":"2024-01-24T12:44:11.350348+0000","last_became_peered":"2024-01-24T12:44:11.350348+0000","last_unstale":"2024-01-24T12:44:12.309684+0000","last_undegraded":"2024-01-24T12:44:12.309684+0000","last_fullsized":"2024-01-24T12:44:12.309684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308183+0000","last_change":"2024-01-24T12:44:11.356890+0000","last_active":"2024-01-24T12:44:12.308183+0000","last_peered":"2024-01-24T12:44:12.308183+0000","last_clean":"2024-01-24T12:44:12.308183+0000","last_became_active":"2024-01-24T12:44:11.356294+0000","last_became_peered":"2024-01-24T12:44:11.356294+0000","last_unstale":"2024-01-24T12:44:12.308183+0000","last_undegraded":"2024-01-24T12:44:12.308183+0000","last_fullsized":"2024-01-24T12:44:12.308183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308450+0000","last_change":"2024-01-24T12:44:11.338748+0000","last_active":"2024-01-24T12:44:12.308450+0000","last_peered":"2024-01-24T12:44:12.308450+0000","last_clean":"2024-01-24T12:44:12.308450+0000","last_became_active":"2024-01-24T12:44:11.337933+0000","last_became_peered":"2024-01-24T12:44:11.337933+0000","last_unstale":"2024-01-24T12:44:12.308450+0000","last_undegraded":"2024-01-24T12:44:12.308450+0000","last_fullsized":"2024-01-24T12:44:12.308450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295959+0000","last_change":"2024-01-24T12:44:11.356535+0000","last_active":"2024-01-24T12:44:12.295959+0000","last_peered":"2024-01-24T12:44:12.295959+0000","last_clean":"2024-01-24T12:44:12.295959+0000","last_became_active":"2024-01-24T12:44:11.356329+0000","last_became_peered":"2024-01-24T12:44:11.356329+0000","last_unstale":"2024-01-24T12:44:12.295959+0000","last_undegraded":"2024-01-24T12:44:12.295959+0000","last_fullsized":"2024-01-24T12:44:12.295959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310566+0000","last_change":"2024-01-24T12:44:11.358761+0000","last_active":"2024-01-24T12:44:12.310566+0000","last_peered":"2024-01-24T12:44:12.310566+0000","last_clean":"2024-01-24T12:44:12.310566+0000","last_became_active":"2024-01-24T12:44:11.358193+0000","last_became_peered":"2024-01-24T12:44:11.358193+0000","last_unstale":"2024-01-24T12:44:12.310566+0000","last_undegraded":"2024-01-24T12:44:12.310566+0000","last_fullsized":"2024-01-24T12:44:12.310566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298433+0000","last_change":"2024-01-24T12:44:11.344182+0000","last_active":"2024-01-24T12:44:12.298433+0000","last_peered":"2024-01-24T12:44:12.298433+0000","last_clean":"2024-01-24T12:44:12.298433+0000","last_became_active":"2024-01-24T12:44:11.343506+0000","last_became_peered":"2024-01-24T12:44:11.343506+0000","last_unstale":"2024-01-24T12:44:12.298433+0000","last_undegraded":"2024-01-24T12:44:12.298433+0000","last_fullsized":"2024-01-24T12:44:12.298433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297856+0000","last_change":"2024-01-24T12:44:11.356600+0000","last_active":"2024-01-24T12:44:12.297856+0000","last_peered":"2024-01-24T12:44:12.297856+0000","last_clean":"2024-01-24T12:44:12.297856+0000","last_became_active":"2024-01-24T12:44:11.355969+0000","last_became_peered":"2024-01-24T12:44:11.355969+0000","last_unstale":"2024-01-24T12:44:12.297856+0000","last_undegraded":"2024-01-24T12:44:12.297856+0000","last_fullsized":"2024-01-24T12:44:12.297856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300489+0000","last_change":"2024-01-24T12:44:11.323993+0000","last_active":"2024-01-24T12:44:12.300489+0000","last_peered":"2024-01-24T12:44:12.300489+0000","last_clean":"2024-01-24T12:44:12.300489+0000","last_became_active":"2024-01-24T12:44:11.323228+0000","last_became_peered":"2024-01-24T12:44:11.323228+0000","last_unstale":"2024-01-24T12:44:12.300489+0000","last_undegraded":"2024-01-24T12:44:12.300489+0000","last_fullsized":"2024-01-24T12:44:12.300489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296421+0000","last_change":"2024-01-24T12:44:11.333852+0000","last_active":"2024-01-24T12:44:12.296421+0000","last_peered":"2024-01-24T12:44:12.296421+0000","last_clean":"2024-01-24T12:44:12.296421+0000","last_became_active":"2024-01-24T12:44:11.333515+0000","last_became_peered":"2024-01-24T12:44:11.333515+0000","last_unstale":"2024-01-24T12:44:12.296421+0000","last_undegraded":"2024-01-24T12:44:12.296421+0000","last_fullsized":"2024-01-24T12:44:12.296421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306748+0000","last_change":"2024-01-24T12:44:11.303301+0000","last_active":"2024-01-24T12:44:12.306748+0000","last_peered":"2024-01-24T12:44:12.306748+0000","last_clean":"2024-01-24T12:44:12.306748+0000","last_became_active":"2024-01-24T12:44:11.303019+0000","last_became_peered":"2024-01-24T12:44:11.303019+0000","last_unstale":"2024-01-24T12:44:12.306748+0000","last_undegraded":"2024-01-24T12:44:12.306748+0000","last_fullsized":"2024-01-24T12:44:12.306748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:27:22.445760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307701+0000","last_change":"2024-01-24T12:44:11.335600+0000","last_active":"2024-01-24T12:44:12.307701+0000","last_peered":"2024-01-24T12:44:12.307701+0000","last_clean":"2024-01-24T12:44:12.307701+0000","last_became_active":"2024-01-24T12:44:11.335242+0000","last_became_peered":"2024-01-24T12:44:11.335242+0000","last_unstale":"2024-01-24T12:44:12.307701+0000","last_undegraded":"2024-01-24T12:44:12.307701+0000","last_fullsized":"2024-01-24T12:44:12.307701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309464+0000","last_change":"2024-01-24T12:44:11.355761+0000","last_active":"2024-01-24T12:44:12.309464+0000","last_peered":"2024-01-24T12:44:12.309464+0000","last_clean":"2024-01-24T12:44:12.309464+0000","last_became_active":"2024-01-24T12:44:11.355005+0000","last_became_peered":"2024-01-24T12:44:11.355005+0000","last_unstale":"2024-01-24T12:44:12.309464+0000","last_undegraded":"2024-01-24T12:44:12.309464+0000","last_fullsized":"2024-01-24T12:44:12.309464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309115+0000","last_change":"2024-01-24T12:44:11.342686+0000","last_active":"2024-01-24T12:44:12.309115+0000","last_peered":"2024-01-24T12:44:12.309115+0000","last_clean":"2024-01-24T12:44:12.309115+0000","last_became_active":"2024-01-24T12:44:11.341936+0000","last_became_peered":"2024-01-24T12:44:11.341936+0000","last_unstale":"2024-01-24T12:44:12.309115+0000","last_undegraded":"2024-01-24T12:44:12.309115+0000","last_fullsized":"2024-01-24T12:44:12.309115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307772+0000","last_change":"2024-01-24T12:44:11.333755+0000","last_active":"2024-01-24T12:44:12.307772+0000","last_peered":"2024-01-24T12:44:12.307772+0000","last_clean":"2024-01-24T12:44:12.307772+0000","last_became_active":"2024-01-24T12:44:11.333446+0000","last_became_peered":"2024-01-24T12:44:11.333446+0000","last_unstale":"2024-01-24T12:44:12.307772+0000","last_undegraded":"2024-01-24T12:44:12.307772+0000","last_fullsized":"2024-01-24T12:44:12.307772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310343+0000","last_change":"2024-01-24T12:44:11.351739+0000","last_active":"2024-01-24T12:44:12.310343+0000","last_peered":"2024-01-24T12:44:12.310343+0000","last_clean":"2024-01-24T12:44:12.310343+0000","last_became_active":"2024-01-24T12:44:11.350438+0000","last_became_peered":"2024-01-24T12:44:11.350438+0000","last_unstale":"2024-01-24T12:44:12.310343+0000","last_undegraded":"2024-01-24T12:44:12.310343+0000","last_fullsized":"2024-01-24T12:44:12.310343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297822+0000","last_change":"2024-01-24T12:44:11.328405+0000","last_active":"2024-01-24T12:44:12.297822+0000","last_peered":"2024-01-24T12:44:12.297822+0000","last_clean":"2024-01-24T12:44:12.297822+0000","last_became_active":"2024-01-24T12:44:11.327290+0000","last_became_peered":"2024-01-24T12:44:11.327290+0000","last_unstale":"2024-01-24T12:44:12.297822+0000","last_undegraded":"2024-01-24T12:44:12.297822+0000","last_fullsized":"2024-01-24T12:44:12.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307157+0000","last_change":"2024-01-24T12:44:11.338647+0000","last_active":"2024-01-24T12:44:12.307157+0000","last_peered":"2024-01-24T12:44:12.307157+0000","last_clean":"2024-01-24T12:44:12.307157+0000","last_became_active":"2024-01-24T12:44:11.338384+0000","last_became_peered":"2024-01-24T12:44:11.338384+0000","last_unstale":"2024-01-24T12:44:12.307157+0000","last_undegraded":"2024-01-24T12:44:12.307157+0000","last_fullsized":"2024-01-24T12:44:12.307157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308232+0000","last_change":"2024-01-24T12:44:11.355653+0000","last_active":"2024-01-24T12:44:12.308232+0000","last_peered":"2024-01-24T12:44:12.308232+0000","last_clean":"2024-01-24T12:44:12.308232+0000","last_became_active":"2024-01-24T12:44:11.354823+0000","last_became_peered":"2024-01-24T12:44:11.354823+0000","last_unstale":"2024-01-24T12:44:12.308232+0000","last_undegraded":"2024-01-24T12:44:12.308232+0000","last_fullsized":"2024-01-24T12:44:12.308232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296174+0000","last_change":"2024-01-24T12:44:11.323202+0000","last_active":"2024-01-24T12:44:12.296174+0000","last_peered":"2024-01-24T12:44:12.296174+0000","last_clean":"2024-01-24T12:44:12.296174+0000","last_became_active":"2024-01-24T12:44:11.322874+0000","last_became_peered":"2024-01-24T12:44:11.322874+0000","last_unstale":"2024-01-24T12:44:12.296174+0000","last_undegraded":"2024-01-24T12:44:12.296174+0000","last_fullsized":"2024-01-24T12:44:12.296174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308180+0000","last_change":"2024-01-24T12:44:11.354498+0000","last_active":"2024-01-24T12:44:12.308180+0000","last_peered":"2024-01-24T12:44:12.308180+0000","last_clean":"2024-01-24T12:44:12.308180+0000","last_became_active":"2024-01-24T12:44:11.353885+0000","last_became_peered":"2024-01-24T12:44:11.353885+0000","last_unstale":"2024-01-24T12:44:12.308180+0000","last_undegraded":"2024-01-24T12:44:12.308180+0000","last_fullsized":"2024-01-24T12:44:12.308180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296059+0000","last_change":"2024-01-24T12:44:11.326023+0000","last_active":"2024-01-24T12:44:12.296059+0000","last_peered":"2024-01-24T12:44:12.296059+0000","last_clean":"2024-01-24T12:44:12.296059+0000","last_became_active":"2024-01-24T12:44:11.325817+0000","last_became_peered":"2024-01-24T12:44:11.325817+0000","last_unstale":"2024-01-24T12:44:12.296059+0000","last_undegraded":"2024-01-24T12:44:12.296059+0000","last_fullsized":"2024-01-24T12:44:12.296059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298514+0000","last_change":"2024-01-24T12:44:11.340890+0000","last_active":"2024-01-24T12:44:12.298514+0000","last_peered":"2024-01-24T12:44:12.298514+0000","last_clean":"2024-01-24T12:44:12.298514+0000","last_became_active":"2024-01-24T12:44:11.340032+0000","last_became_peered":"2024-01-24T12:44:11.340032+0000","last_unstale":"2024-01-24T12:44:12.298514+0000","last_undegraded":"2024-01-24T12:44:12.298514+0000","last_fullsized":"2024-01-24T12:44:12.298514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308552+0000","last_change":"2024-01-24T12:44:11.304881+0000","last_active":"2024-01-24T12:44:12.308552+0000","last_peered":"2024-01-24T12:44:12.308552+0000","last_clean":"2024-01-24T12:44:12.308552+0000","last_became_active":"2024-01-24T12:44:11.304584+0000","last_became_peered":"2024-01-24T12:44:11.304584+0000","last_unstale":"2024-01-24T12:44:12.308552+0000","last_undegraded":"2024-01-24T12:44:12.308552+0000","last_fullsized":"2024-01-24T12:44:12.308552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296302+0000","last_change":"2024-01-24T12:44:11.325073+0000","last_active":"2024-01-24T12:44:12.296302+0000","last_peered":"2024-01-24T12:44:12.296302+0000","last_clean":"2024-01-24T12:44:12.296302+0000","last_became_active":"2024-01-24T12:44:11.324807+0000","last_became_peered":"2024-01-24T12:44:11.324807+0000","last_unstale":"2024-01-24T12:44:12.296302+0000","last_undegraded":"2024-01-24T12:44:12.296302+0000","last_fullsized":"2024-01-24T12:44:12.296302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307195+0000","last_change":"2024-01-24T12:44:11.303436+0000","last_active":"2024-01-24T12:44:12.307195+0000","last_peered":"2024-01-24T12:44:12.307195+0000","last_clean":"2024-01-24T12:44:12.307195+0000","last_became_active":"2024-01-24T12:44:11.303191+0000","last_became_peered":"2024-01-24T12:44:11.303191+0000","last_unstale":"2024-01-24T12:44:12.307195+0000","last_undegraded":"2024-01-24T12:44:12.307195+0000","last_fullsized":"2024-01-24T12:44:12.307195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308464+0000","last_change":"2024-01-24T12:44:11.355739+0000","last_active":"2024-01-24T12:44:12.308464+0000","last_peered":"2024-01-24T12:44:12.308464+0000","last_clean":"2024-01-24T12:44:12.308464+0000","last_became_active":"2024-01-24T12:44:11.354956+0000","last_became_peered":"2024-01-24T12:44:11.354956+0000","last_unstale":"2024-01-24T12:44:12.308464+0000","last_undegraded":"2024-01-24T12:44:12.308464+0000","last_fullsized":"2024-01-24T12:44:12.308464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307893+0000","last_change":"2024-01-24T12:44:11.341356+0000","last_active":"2024-01-24T12:44:12.307893+0000","last_peered":"2024-01-24T12:44:12.307893+0000","last_clean":"2024-01-24T12:44:12.307893+0000","last_became_active":"2024-01-24T12:44:11.341002+0000","last_became_peered":"2024-01-24T12:44:11.341002+0000","last_unstale":"2024-01-24T12:44:12.307893+0000","last_undegraded":"2024-01-24T12:44:12.307893+0000","last_fullsized":"2024-01-24T12:44:12.307893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297329+0000","last_change":"2024-01-24T12:44:11.318461+0000","last_active":"2024-01-24T12:44:12.297329+0000","last_peered":"2024-01-24T12:44:12.297329+0000","last_clean":"2024-01-24T12:44:12.297329+0000","last_became_active":"2024-01-24T12:44:11.317738+0000","last_became_peered":"2024-01-24T12:44:11.317738+0000","last_unstale":"2024-01-24T12:44:12.297329+0000","last_undegraded":"2024-01-24T12:44:12.297329+0000","last_fullsized":"2024-01-24T12:44:12.297329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299592+0000","last_change":"2024-01-24T12:44:11.324214+0000","last_active":"2024-01-24T12:44:12.299592+0000","last_peered":"2024-01-24T12:44:12.299592+0000","last_clean":"2024-01-24T12:44:12.299592+0000","last_became_active":"2024-01-24T12:44:11.323445+0000","last_became_peered":"2024-01-24T12:44:11.323445+0000","last_unstale":"2024-01-24T12:44:12.299592+0000","last_undegraded":"2024-01-24T12:44:12.299592+0000","last_fullsized":"2024-01-24T12:44:12.299592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296576+0000","last_change":"2024-01-24T12:44:10.955244+0000","last_active":"2024-01-24T12:44:12.296576+0000","last_peered":"2024-01-24T12:44:12.296576+0000","last_clean":"2024-01-24T12:44:12.296576+0000","last_became_active":"2024-01-24T12:44:10.954900+0000","last_became_peered":"2024-01-24T12:44:10.954900+0000","last_unstale":"2024-01-24T12:44:12.296576+0000","last_undegraded":"2024-01-24T12:44:12.296576+0000","last_fullsized":"2024-01-24T12:44:12.296576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307282+0000","last_change":"2024-01-24T12:44:11.322525+0000","last_active":"2024-01-24T12:44:12.307282+0000","last_peered":"2024-01-24T12:44:12.307282+0000","last_clean":"2024-01-24T12:44:12.307282+0000","last_became_active":"2024-01-24T12:44:11.322196+0000","last_became_peered":"2024-01-24T12:44:11.322196+0000","last_unstale":"2024-01-24T12:44:12.307282+0000","last_undegraded":"2024-01-24T12:44:12.307282+0000","last_fullsized":"2024-01-24T12:44:12.307282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297693+0000","last_change":"2024-01-24T12:44:10.938016+0000","last_active":"2024-01-24T12:44:12.297693+0000","last_peered":"2024-01-24T12:44:12.297693+0000","last_clean":"2024-01-24T12:44:12.297693+0000","last_became_active":"2024-01-24T12:44:10.937051+0000","last_became_peered":"2024-01-24T12:44:10.937051+0000","last_unstale":"2024-01-24T12:44:12.297693+0000","last_undegraded":"2024-01-24T12:44:12.297693+0000","last_fullsized":"2024-01-24T12:44:12.297693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296065+0000","last_change":"2024-01-24T12:44:10.944973+0000","last_active":"2024-01-24T12:44:12.296065+0000","last_peered":"2024-01-24T12:44:12.296065+0000","last_clean":"2024-01-24T12:44:12.296065+0000","last_became_active":"2024-01-24T12:44:10.944391+0000","last_became_peered":"2024-01-24T12:44:10.944391+0000","last_unstale":"2024-01-24T12:44:12.296065+0000","last_undegraded":"2024-01-24T12:44:12.296065+0000","last_fullsized":"2024-01-24T12:44:12.296065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296241+0000","last_change":"2024-01-24T12:44:11.306739+0000","last_active":"2024-01-24T12:44:12.296241+0000","last_peered":"2024-01-24T12:44:12.296241+0000","last_clean":"2024-01-24T12:44:12.296241+0000","last_became_active":"2024-01-24T12:44:11.306515+0000","last_became_peered":"2024-01-24T12:44:11.306515+0000","last_unstale":"2024-01-24T12:44:12.296241+0000","last_undegraded":"2024-01-24T12:44:12.296241+0000","last_fullsized":"2024-01-24T12:44:12.296241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308408+0000","last_change":"2024-01-24T12:44:10.937679+0000","last_active":"2024-01-24T12:44:12.308408+0000","last_peered":"2024-01-24T12:44:12.308408+0000","last_clean":"2024-01-24T12:44:12.308408+0000","last_became_active":"2024-01-24T12:44:10.936808+0000","last_became_peered":"2024-01-24T12:44:10.936808+0000","last_unstale":"2024-01-24T12:44:12.308408+0000","last_undegraded":"2024-01-24T12:44:12.308408+0000","last_fullsized":"2024-01-24T12:44:12.308408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307614+0000","last_change":"2024-01-24T12:44:11.305203+0000","last_active":"2024-01-24T12:44:12.307614+0000","last_peered":"2024-01-24T12:44:12.307614+0000","last_clean":"2024-01-24T12:44:12.307614+0000","last_became_active":"2024-01-24T12:44:11.304919+0000","last_became_peered":"2024-01-24T12:44:11.304919+0000","last_unstale":"2024-01-24T12:44:12.307614+0000","last_undegraded":"2024-01-24T12:44:12.307614+0000","last_fullsized":"2024-01-24T12:44:12.307614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298446+0000","last_change":"2024-01-24T12:44:10.949242+0000","last_active":"2024-01-24T12:44:12.298446+0000","last_peered":"2024-01-24T12:44:12.298446+0000","last_clean":"2024-01-24T12:44:12.298446+0000","last_became_active":"2024-01-24T12:44:10.948044+0000","last_became_peered":"2024-01-24T12:44:10.948044+0000","last_unstale":"2024-01-24T12:44:12.298446+0000","last_undegraded":"2024-01-24T12:44:12.298446+0000","last_fullsized":"2024-01-24T12:44:12.298446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308948+0000","last_change":"2024-01-24T12:44:11.346554+0000","last_active":"2024-01-24T12:44:12.308948+0000","last_peered":"2024-01-24T12:44:12.308948+0000","last_clean":"2024-01-24T12:44:12.308948+0000","last_became_active":"2024-01-24T12:44:11.345775+0000","last_became_peered":"2024-01-24T12:44:11.345775+0000","last_unstale":"2024-01-24T12:44:12.308948+0000","last_undegraded":"2024-01-24T12:44:12.308948+0000","last_fullsized":"2024-01-24T12:44:12.308948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309141+0000","last_change":"2024-01-24T12:44:10.944636+0000","last_active":"2024-01-24T12:44:12.309141+0000","last_peered":"2024-01-24T12:44:12.309141+0000","last_clean":"2024-01-24T12:44:12.309141+0000","last_became_active":"2024-01-24T12:44:10.943901+0000","last_became_peered":"2024-01-24T12:44:10.943901+0000","last_unstale":"2024-01-24T12:44:12.309141+0000","last_undegraded":"2024-01-24T12:44:12.309141+0000","last_fullsized":"2024-01-24T12:44:12.309141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307177+0000","last_change":"2024-01-24T12:44:11.343815+0000","last_active":"2024-01-24T12:44:12.307177+0000","last_peered":"2024-01-24T12:44:12.307177+0000","last_clean":"2024-01-24T12:44:12.307177+0000","last_became_active":"2024-01-24T12:44:11.343536+0000","last_became_peered":"2024-01-24T12:44:11.343536+0000","last_unstale":"2024-01-24T12:44:12.307177+0000","last_undegraded":"2024-01-24T12:44:12.307177+0000","last_fullsized":"2024-01-24T12:44:12.307177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.948117+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.947825+0000","last_became_peered":"2024-01-24T12:44:10.947825+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300676+0000","last_change":"2024-01-24T12:44:11.340824+0000","last_active":"2024-01-24T12:44:12.300676+0000","last_peered":"2024-01-24T12:44:12.300676+0000","last_clean":"2024-01-24T12:44:12.300676+0000","last_became_active":"2024-01-24T12:44:11.340194+0000","last_became_peered":"2024-01-24T12:44:11.340194+0000","last_unstale":"2024-01-24T12:44:12.300676+0000","last_undegraded":"2024-01-24T12:44:12.300676+0000","last_fullsized":"2024-01-24T12:44:12.300676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297929+0000","last_change":"2024-01-24T12:44:10.932460+0000","last_active":"2024-01-24T12:44:12.297929+0000","last_peered":"2024-01-24T12:44:12.297929+0000","last_clean":"2024-01-24T12:44:12.297929+0000","last_became_active":"2024-01-24T12:44:10.931678+0000","last_became_peered":"2024-01-24T12:44:10.931678+0000","last_unstale":"2024-01-24T12:44:12.297929+0000","last_undegraded":"2024-01-24T12:44:12.297929+0000","last_fullsized":"2024-01-24T12:44:12.297929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310013+0000","last_change":"2024-01-24T12:44:11.338493+0000","last_active":"2024-01-24T12:44:12.310013+0000","last_peered":"2024-01-24T12:44:12.310013+0000","last_clean":"2024-01-24T12:44:12.310013+0000","last_became_active":"2024-01-24T12:44:11.337805+0000","last_became_peered":"2024-01-24T12:44:11.337805+0000","last_unstale":"2024-01-24T12:44:12.310013+0000","last_undegraded":"2024-01-24T12:44:12.310013+0000","last_fullsized":"2024-01-24T12:44:12.310013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307465+0000","last_change":"2024-01-24T12:44:10.948122+0000","last_active":"2024-01-24T12:44:12.307465+0000","last_peered":"2024-01-24T12:44:12.307465+0000","last_clean":"2024-01-24T12:44:12.307465+0000","last_became_active":"2024-01-24T12:44:10.947868+0000","last_became_peered":"2024-01-24T12:44:10.947868+0000","last_unstale":"2024-01-24T12:44:12.307465+0000","last_undegraded":"2024-01-24T12:44:12.307465+0000","last_fullsized":"2024-01-24T12:44:12.307465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306691+0000","last_change":"2024-01-24T12:44:11.338719+0000","last_active":"2024-01-24T12:44:12.306691+0000","last_peered":"2024-01-24T12:44:12.306691+0000","last_clean":"2024-01-24T12:44:12.306691+0000","last_became_active":"2024-01-24T12:44:11.338420+0000","last_became_peered":"2024-01-24T12:44:11.338420+0000","last_unstale":"2024-01-24T12:44:12.306691+0000","last_undegraded":"2024-01-24T12:44:12.306691+0000","last_fullsized":"2024-01-24T12:44:12.306691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308469+0000","last_change":"2024-01-24T12:44:10.942141+0000","last_active":"2024-01-24T12:44:12.308469+0000","last_peered":"2024-01-24T12:44:12.308469+0000","last_clean":"2024-01-24T12:44:12.308469+0000","last_became_active":"2024-01-24T12:44:10.940912+0000","last_became_peered":"2024-01-24T12:44:10.940912+0000","last_unstale":"2024-01-24T12:44:12.308469+0000","last_undegraded":"2024-01-24T12:44:12.308469+0000","last_fullsized":"2024-01-24T12:44:12.308469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309938+0000","last_change":"2024-01-24T12:44:11.351939+0000","last_active":"2024-01-24T12:44:12.309938+0000","last_peered":"2024-01-24T12:44:12.309938+0000","last_clean":"2024-01-24T12:44:12.309938+0000","last_became_active":"2024-01-24T12:44:11.351433+0000","last_became_peered":"2024-01-24T12:44:11.351433+0000","last_unstale":"2024-01-24T12:44:12.309938+0000","last_undegraded":"2024-01-24T12:44:12.309938+0000","last_fullsized":"2024-01-24T12:44:12.309938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297489+0000","last_change":"2024-01-24T12:44:10.937971+0000","last_active":"2024-01-24T12:44:12.297489+0000","last_peered":"2024-01-24T12:44:12.297489+0000","last_clean":"2024-01-24T12:44:12.297489+0000","last_became_active":"2024-01-24T12:44:10.937130+0000","last_became_peered":"2024-01-24T12:44:10.937130+0000","last_unstale":"2024-01-24T12:44:12.297489+0000","last_undegraded":"2024-01-24T12:44:12.297489+0000","last_fullsized":"2024-01-24T12:44:12.297489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297341+0000","last_change":"2024-01-24T12:44:11.317998+0000","last_active":"2024-01-24T12:44:12.297341+0000","last_peered":"2024-01-24T12:44:12.297341+0000","last_clean":"2024-01-24T12:44:12.297341+0000","last_became_active":"2024-01-24T12:44:11.313220+0000","last_became_peered":"2024-01-24T12:44:11.313220+0000","last_unstale":"2024-01-24T12:44:12.297341+0000","last_undegraded":"2024-01-24T12:44:12.297341+0000","last_fullsized":"2024-01-24T12:44:12.297341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307832+0000","last_change":"2024-01-24T12:44:10.935739+0000","last_active":"2024-01-24T12:44:12.307832+0000","last_peered":"2024-01-24T12:44:12.307832+0000","last_clean":"2024-01-24T12:44:12.307832+0000","last_became_active":"2024-01-24T12:44:10.935329+0000","last_became_peered":"2024-01-24T12:44:10.935329+0000","last_unstale":"2024-01-24T12:44:12.307832+0000","last_undegraded":"2024-01-24T12:44:12.307832+0000","last_fullsized":"2024-01-24T12:44:12.307832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309364+0000","last_change":"2024-01-24T12:44:11.344235+0000","last_active":"2024-01-24T12:44:12.309364+0000","last_peered":"2024-01-24T12:44:12.309364+0000","last_clean":"2024-01-24T12:44:12.309364+0000","last_became_active":"2024-01-24T12:44:11.343638+0000","last_became_peered":"2024-01-24T12:44:11.343638+0000","last_unstale":"2024-01-24T12:44:12.309364+0000","last_undegraded":"2024-01-24T12:44:12.309364+0000","last_fullsized":"2024-01-24T12:44:12.309364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:43.676453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300535+0000","last_change":"2024-01-24T12:44:10.934962+0000","last_active":"2024-01-24T12:44:12.300535+0000","last_peered":"2024-01-24T12:44:12.300535+0000","last_clean":"2024-01-24T12:44:12.300535+0000","last_became_active":"2024-01-24T12:44:10.934179+0000","last_became_peered":"2024-01-24T12:44:10.934179+0000","last_unstale":"2024-01-24T12:44:12.300535+0000","last_undegraded":"2024-01-24T12:44:12.300535+0000","last_fullsized":"2024-01-24T12:44:12.300535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310395+0000","last_change":"2024-01-24T12:44:11.345146+0000","last_active":"2024-01-24T12:44:12.310395+0000","last_peered":"2024-01-24T12:44:12.310395+0000","last_clean":"2024-01-24T12:44:12.310395+0000","last_became_active":"2024-01-24T12:44:11.343454+0000","last_became_peered":"2024-01-24T12:44:11.343454+0000","last_unstale":"2024-01-24T12:44:12.310395+0000","last_undegraded":"2024-01-24T12:44:12.310395+0000","last_fullsized":"2024-01-24T12:44:12.310395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:45:06.184578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308221+0000","last_change":"2024-01-24T12:44:10.941647+0000","last_active":"2024-01-24T12:44:12.308221+0000","last_peered":"2024-01-24T12:44:12.308221+0000","last_clean":"2024-01-24T12:44:12.308221+0000","last_became_active":"2024-01-24T12:44:10.941177+0000","last_became_peered":"2024-01-24T12:44:10.941177+0000","last_unstale":"2024-01-24T12:44:12.308221+0000","last_undegraded":"2024-01-24T12:44:12.308221+0000","last_fullsized":"2024-01-24T12:44:12.308221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310690+0000","last_change":"2024-01-24T12:44:11.350856+0000","last_active":"2024-01-24T12:44:12.310690+0000","last_peered":"2024-01-24T12:44:12.310690+0000","last_clean":"2024-01-24T12:44:12.310690+0000","last_became_active":"2024-01-24T12:44:11.350244+0000","last_became_peered":"2024-01-24T12:44:11.350244+0000","last_unstale":"2024-01-24T12:44:12.310690+0000","last_undegraded":"2024-01-24T12:44:12.310690+0000","last_fullsized":"2024-01-24T12:44:12.310690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:31:04.636860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308635+0000","last_change":"2024-01-24T12:44:10.937540+0000","last_active":"2024-01-24T12:44:12.308635+0000","last_peered":"2024-01-24T12:44:12.308635+0000","last_clean":"2024-01-24T12:44:12.308635+0000","last_became_active":"2024-01-24T12:44:10.937246+0000","last_became_peered":"2024-01-24T12:44:10.937246+0000","last_unstale":"2024-01-24T12:44:12.308635+0000","last_undegraded":"2024-01-24T12:44:12.308635+0000","last_fullsized":"2024-01-24T12:44:12.308635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309138+0000","last_change":"2024-01-24T12:44:11.345714+0000","last_active":"2024-01-24T12:44:12.309138+0000","last_peered":"2024-01-24T12:44:12.309138+0000","last_clean":"2024-01-24T12:44:12.309138+0000","last_became_active":"2024-01-24T12:44:11.340127+0000","last_became_peered":"2024-01-24T12:44:11.340127+0000","last_unstale":"2024-01-24T12:44:12.309138+0000","last_undegraded":"2024-01-24T12:44:12.309138+0000","last_fullsized":"2024-01-24T12:44:12.309138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307978+0000","last_change":"2024-01-24T12:44:10.946919+0000","last_active":"2024-01-24T12:44:12.307978+0000","last_peered":"2024-01-24T12:44:12.307978+0000","last_clean":"2024-01-24T12:44:12.307978+0000","last_became_active":"2024-01-24T12:44:10.946607+0000","last_became_peered":"2024-01-24T12:44:10.946607+0000","last_unstale":"2024-01-24T12:44:12.307978+0000","last_undegraded":"2024-01-24T12:44:12.307978+0000","last_fullsized":"2024-01-24T12:44:12.307978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310112+0000","last_change":"2024-01-24T12:44:11.357380+0000","last_active":"2024-01-24T12:44:12.310112+0000","last_peered":"2024-01-24T12:44:12.310112+0000","last_clean":"2024-01-24T12:44:12.310112+0000","last_became_active":"2024-01-24T12:44:11.356720+0000","last_became_peered":"2024-01-24T12:44:11.356720+0000","last_unstale":"2024-01-24T12:44:12.310112+0000","last_undegraded":"2024-01-24T12:44:12.310112+0000","last_fullsized":"2024-01-24T12:44:12.310112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-24T12:44:11.307644+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:11.307644+0000","last_peered":"2024-01-24T12:44:11.307644+0000","last_clean":"2024-01-24T12:44:11.307644+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:11.307644+0000","last_undegraded":"2024-01-24T12:44:11.307644+0000","last_fullsized":"2024-01-24T12:44:11.307644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309210+0000","last_change":"2024-01-24T12:44:10.932841+0000","last_active":"2024-01-24T12:44:12.309210+0000","last_peered":"2024-01-24T12:44:12.309210+0000","last_clean":"2024-01-24T12:44:12.309210+0000","last_became_active":"2024-01-24T12:44:10.931862+0000","last_became_peered":"2024-01-24T12:44:10.931862+0000","last_unstale":"2024-01-24T12:44:12.309210+0000","last_undegraded":"2024-01-24T12:44:12.309210+0000","last_fullsized":"2024-01-24T12:44:12.309210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295950+0000","last_change":"2024-01-24T12:44:11.356544+0000","last_active":"2024-01-24T12:44:12.295950+0000","last_peered":"2024-01-24T12:44:12.295950+0000","last_clean":"2024-01-24T12:44:12.295950+0000","last_became_active":"2024-01-24T12:44:11.356289+0000","last_became_peered":"2024-01-24T12:44:11.356289+0000","last_unstale":"2024-01-24T12:44:12.295950+0000","last_undegraded":"2024-01-24T12:44:12.295950+0000","last_fullsized":"2024-01-24T12:44:12.295950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.954636+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.953755+0000","last_became_peered":"2024-01-24T12:44:10.953755+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306843+0000","last_change":"2024-01-24T12:44:11.322569+0000","last_active":"2024-01-24T12:44:12.306843+0000","last_peered":"2024-01-24T12:44:12.306843+0000","last_clean":"2024-01-24T12:44:12.306843+0000","last_became_active":"2024-01-24T12:44:11.322253+0000","last_became_peered":"2024-01-24T12:44:11.322253+0000","last_unstale":"2024-01-24T12:44:12.306843+0000","last_undegraded":"2024-01-24T12:44:12.306843+0000","last_fullsized":"2024-01-24T12:44:12.306843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308008+0000","last_change":"2024-01-24T12:44:10.941900+0000","last_active":"2024-01-24T12:44:12.308008+0000","last_peered":"2024-01-24T12:44:12.308008+0000","last_clean":"2024-01-24T12:44:12.308008+0000","last_became_active":"2024-01-24T12:44:10.941526+0000","last_became_peered":"2024-01-24T12:44:10.941526+0000","last_unstale":"2024-01-24T12:44:12.308008+0000","last_undegraded":"2024-01-24T12:44:12.308008+0000","last_fullsized":"2024-01-24T12:44:12.308008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307635+0000","last_change":"2024-01-24T12:44:11.306700+0000","last_active":"2024-01-24T12:44:12.307635+0000","last_peered":"2024-01-24T12:44:12.307635+0000","last_clean":"2024-01-24T12:44:12.307635+0000","last_became_active":"2024-01-24T12:44:11.306420+0000","last_became_peered":"2024-01-24T12:44:11.306420+0000","last_unstale":"2024-01-24T12:44:12.307635+0000","last_undegraded":"2024-01-24T12:44:12.307635+0000","last_fullsized":"2024-01-24T12:44:12.307635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308705+0000","last_change":"2024-01-24T12:44:10.939127+0000","last_active":"2024-01-24T12:44:12.308705+0000","last_peered":"2024-01-24T12:44:12.308705+0000","last_clean":"2024-01-24T12:44:12.308705+0000","last_became_active":"2024-01-24T12:44:10.936034+0000","last_became_peered":"2024-01-24T12:44:10.936034+0000","last_unstale":"2024-01-24T12:44:12.308705+0000","last_undegraded":"2024-01-24T12:44:12.308705+0000","last_fullsized":"2024-01-24T12:44:12.308705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300705+0000","last_change":"2024-01-24T12:44:11.326553+0000","last_active":"2024-01-24T12:44:12.300705+0000","last_peered":"2024-01-24T12:44:12.300705+0000","last_clean":"2024-01-24T12:44:12.300705+0000","last_became_active":"2024-01-24T12:44:11.322735+0000","last_became_peered":"2024-01-24T12:44:11.322735+0000","last_unstale":"2024-01-24T12:44:12.300705+0000","last_undegraded":"2024-01-24T12:44:12.300705+0000","last_fullsized":"2024-01-24T12:44:12.300705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308725+0000","last_change":"2024-01-24T12:44:10.932249+0000","last_active":"2024-01-24T12:44:12.308725+0000","last_peered":"2024-01-24T12:44:12.308725+0000","last_clean":"2024-01-24T12:44:12.308725+0000","last_became_active":"2024-01-24T12:44:10.931916+0000","last_became_peered":"2024-01-24T12:44:10.931916+0000","last_unstale":"2024-01-24T12:44:12.308725+0000","last_undegraded":"2024-01-24T12:44:12.308725+0000","last_fullsized":"2024-01-24T12:44:12.308725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308828+0000","last_change":"2024-01-24T12:44:11.341472+0000","last_active":"2024-01-24T12:44:12.308828+0000","last_peered":"2024-01-24T12:44:12.308828+0000","last_clean":"2024-01-24T12:44:12.308828+0000","last_became_active":"2024-01-24T12:44:11.339574+0000","last_became_peered":"2024-01-24T12:44:11.339574+0000","last_unstale":"2024-01-24T12:44:12.308828+0000","last_undegraded":"2024-01-24T12:44:12.308828+0000","last_fullsized":"2024-01-24T12:44:12.308828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310484+0000","last_change":"2024-01-24T12:44:10.954824+0000","last_active":"2024-01-24T12:44:12.310484+0000","last_peered":"2024-01-24T12:44:12.310484+0000","last_clean":"2024-01-24T12:44:12.310484+0000","last_became_active":"2024-01-24T12:44:10.953995+0000","last_became_peered":"2024-01-24T12:44:10.953995+0000","last_unstale":"2024-01-24T12:44:12.310484+0000","last_undegraded":"2024-01-24T12:44:12.310484+0000","last_fullsized":"2024-01-24T12:44:12.310484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:46.778299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308748+0000","last_change":"2024-01-24T12:44:11.306822+0000","last_active":"2024-01-24T12:44:12.308748+0000","last_peered":"2024-01-24T12:44:12.308748+0000","last_clean":"2024-01-24T12:44:12.308748+0000","last_became_active":"2024-01-24T12:44:11.306582+0000","last_became_peered":"2024-01-24T12:44:11.306582+0000","last_unstale":"2024-01-24T12:44:12.308748+0000","last_undegraded":"2024-01-24T12:44:12.308748+0000","last_fullsized":"2024-01-24T12:44:12.308748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:14.661252+0000","last_change":"2024-01-24T12:44:10.945081+0000","last_active":"2024-01-24T12:44:14.661252+0000","last_peered":"2024-01-24T12:44:14.661252+0000","last_clean":"2024-01-24T12:44:14.661252+0000","last_became_active":"2024-01-24T12:44:10.944818+0000","last_became_peered":"2024-01-24T12:44:10.944818+0000","last_unstale":"2024-01-24T12:44:14.661252+0000","last_undegraded":"2024-01-24T12:44:14.661252+0000","last_fullsized":"2024-01-24T12:44:14.661252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296235+0000","last_change":"2024-01-24T12:44:11.338803+0000","last_active":"2024-01-24T12:44:12.296235+0000","last_peered":"2024-01-24T12:44:12.296235+0000","last_clean":"2024-01-24T12:44:12.296235+0000","last_became_active":"2024-01-24T12:44:11.338477+0000","last_became_peered":"2024-01-24T12:44:11.338477+0000","last_unstale":"2024-01-24T12:44:12.296235+0000","last_undegraded":"2024-01-24T12:44:12.296235+0000","last_fullsized":"2024-01-24T12:44:12.296235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298588+0000","last_change":"2024-01-24T12:44:10.939339+0000","last_active":"2024-01-24T12:44:12.298588+0000","last_peered":"2024-01-24T12:44:12.298588+0000","last_clean":"2024-01-24T12:44:12.298588+0000","last_became_active":"2024-01-24T12:44:10.938406+0000","last_became_peered":"2024-01-24T12:44:10.938406+0000","last_unstale":"2024-01-24T12:44:12.298588+0000","last_undegraded":"2024-01-24T12:44:12.298588+0000","last_fullsized":"2024-01-24T12:44:12.298588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307008+0000","last_change":"2024-01-24T12:44:11.302425+0000","last_active":"2024-01-24T12:44:12.307008+0000","last_peered":"2024-01-24T12:44:12.307008+0000","last_clean":"2024-01-24T12:44:12.307008+0000","last_became_active":"2024-01-24T12:44:11.302126+0000","last_became_peered":"2024-01-24T12:44:11.302126+0000","last_unstale":"2024-01-24T12:44:12.307008+0000","last_undegraded":"2024-01-24T12:44:12.307008+0000","last_fullsized":"2024-01-24T12:44:12.307008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308420+0000","last_change":"2024-01-24T12:44:10.954419+0000","last_active":"2024-01-24T12:44:12.308420+0000","last_peered":"2024-01-24T12:44:12.308420+0000","last_clean":"2024-01-24T12:44:12.308420+0000","last_became_active":"2024-01-24T12:44:10.953740+0000","last_became_peered":"2024-01-24T12:44:10.953740+0000","last_unstale":"2024-01-24T12:44:12.308420+0000","last_undegraded":"2024-01-24T12:44:12.308420+0000","last_fullsized":"2024-01-24T12:44:12.308420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:41.145058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299297+0000","last_change":"2024-01-24T12:44:11.323414+0000","last_active":"2024-01-24T12:44:12.299297+0000","last_peered":"2024-01-24T12:44:12.299297+0000","last_clean":"2024-01-24T12:44:12.299297+0000","last_became_active":"2024-01-24T12:44:11.321676+0000","last_became_peered":"2024-01-24T12:44:11.321676+0000","last_unstale":"2024-01-24T12:44:12.299297+0000","last_undegraded":"2024-01-24T12:44:12.299297+0000","last_fullsized":"2024-01-24T12:44:12.299297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:24.995947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308370+0000","last_change":"2024-01-24T12:44:10.932826+0000","last_active":"2024-01-24T12:44:12.308370+0000","last_peered":"2024-01-24T12:44:12.308370+0000","last_clean":"2024-01-24T12:44:12.308370+0000","last_became_active":"2024-01-24T12:44:10.931858+0000","last_became_peered":"2024-01-24T12:44:10.931858+0000","last_unstale":"2024-01-24T12:44:12.308370+0000","last_undegraded":"2024-01-24T12:44:12.308370+0000","last_fullsized":"2024-01-24T12:44:12.308370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296392+0000","last_change":"2024-01-24T12:44:11.305338+0000","last_active":"2024-01-24T12:44:12.296392+0000","last_peered":"2024-01-24T12:44:12.296392+0000","last_clean":"2024-01-24T12:44:12.296392+0000","last_became_active":"2024-01-24T12:44:11.305113+0000","last_became_peered":"2024-01-24T12:44:11.305113+0000","last_unstale":"2024-01-24T12:44:12.296392+0000","last_undegraded":"2024-01-24T12:44:12.296392+0000","last_fullsized":"2024-01-24T12:44:12.296392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308535+0000","last_change":"2024-01-24T12:44:10.943496+0000","last_active":"2024-01-24T12:44:12.308535+0000","last_peered":"2024-01-24T12:44:12.308535+0000","last_clean":"2024-01-24T12:44:12.308535+0000","last_became_active":"2024-01-24T12:44:10.943191+0000","last_became_peered":"2024-01-24T12:44:10.943191+0000","last_unstale":"2024-01-24T12:44:12.308535+0000","last_undegraded":"2024-01-24T12:44:12.308535+0000","last_fullsized":"2024-01-24T12:44:12.308535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296559+0000","last_change":"2024-01-24T12:44:11.306336+0000","last_active":"2024-01-24T12:44:12.296559+0000","last_peered":"2024-01-24T12:44:12.296559+0000","last_clean":"2024-01-24T12:44:12.296559+0000","last_became_active":"2024-01-24T12:44:11.306052+0000","last_became_peered":"2024-01-24T12:44:11.306052+0000","last_unstale":"2024-01-24T12:44:12.296559+0000","last_undegraded":"2024-01-24T12:44:12.296559+0000","last_fullsized":"2024-01-24T12:44:12.296559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310071+0000","last_change":"2024-01-24T12:44:10.959081+0000","last_active":"2024-01-24T12:44:12.310071+0000","last_peered":"2024-01-24T12:44:12.310071+0000","last_clean":"2024-01-24T12:44:12.310071+0000","last_became_active":"2024-01-24T12:44:10.956226+0000","last_became_peered":"2024-01-24T12:44:10.956226+0000","last_unstale":"2024-01-24T12:44:12.310071+0000","last_undegraded":"2024-01-24T12:44:12.310071+0000","last_fullsized":"2024-01-24T12:44:12.310071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:37.678733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297441+0000","last_change":"2024-01-24T12:44:11.335329+0000","last_active":"2024-01-24T12:44:12.297441+0000","last_peered":"2024-01-24T12:44:12.297441+0000","last_clean":"2024-01-24T12:44:12.297441+0000","last_became_active":"2024-01-24T12:44:11.334560+0000","last_became_peered":"2024-01-24T12:44:11.334560+0000","last_unstale":"2024-01-24T12:44:12.297441+0000","last_undegraded":"2024-01-24T12:44:12.297441+0000","last_fullsized":"2024-01-24T12:44:12.297441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309208+0000","last_change":"2024-01-24T12:44:11.357364+0000","last_active":"2024-01-24T12:44:12.309208+0000","last_peered":"2024-01-24T12:44:12.309208+0000","last_clean":"2024-01-24T12:44:12.309208+0000","last_became_active":"2024-01-24T12:44:11.354163+0000","last_became_peered":"2024-01-24T12:44:11.354163+0000","last_unstale":"2024-01-24T12:44:12.309208+0000","last_undegraded":"2024-01-24T12:44:12.309208+0000","last_fullsized":"2024-01-24T12:44:12.309208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309831+0000","last_change":"2024-01-24T12:44:10.954300+0000","last_active":"2024-01-24T12:44:12.309831+0000","last_peered":"2024-01-24T12:44:12.309831+0000","last_clean":"2024-01-24T12:44:12.309831+0000","last_became_active":"2024-01-24T12:44:10.953779+0000","last_became_peered":"2024-01-24T12:44:10.953779+0000","last_unstale":"2024-01-24T12:44:12.309831+0000","last_undegraded":"2024-01-24T12:44:12.309831+0000","last_fullsized":"2024-01-24T12:44:12.309831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:58.271375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308883+0000","last_change":"2024-01-24T12:44:11.343616+0000","last_active":"2024-01-24T12:44:12.308883+0000","last_peered":"2024-01-24T12:44:12.308883+0000","last_clean":"2024-01-24T12:44:12.308883+0000","last_became_active":"2024-01-24T12:44:11.342012+0000","last_became_peered":"2024-01-24T12:44:11.342012+0000","last_unstale":"2024-01-24T12:44:12.308883+0000","last_undegraded":"2024-01-24T12:44:12.308883+0000","last_fullsized":"2024-01-24T12:44:12.308883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310244+0000","last_change":"2024-01-24T12:44:10.956362+0000","last_active":"2024-01-24T12:44:12.310244+0000","last_peered":"2024-01-24T12:44:12.310244+0000","last_clean":"2024-01-24T12:44:12.310244+0000","last_became_active":"2024-01-24T12:44:10.955703+0000","last_became_peered":"2024-01-24T12:44:10.955703+0000","last_unstale":"2024-01-24T12:44:12.310244+0000","last_undegraded":"2024-01-24T12:44:12.310244+0000","last_fullsized":"2024-01-24T12:44:12.310244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:23.984897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307009+0000","last_change":"2024-01-24T12:44:11.356491+0000","last_active":"2024-01-24T12:44:12.307009+0000","last_peered":"2024-01-24T12:44:12.307009+0000","last_clean":"2024-01-24T12:44:12.307009+0000","last_became_active":"2024-01-24T12:44:11.356182+0000","last_became_peered":"2024-01-24T12:44:11.356182+0000","last_unstale":"2024-01-24T12:44:12.307009+0000","last_undegraded":"2024-01-24T12:44:12.307009+0000","last_fullsized":"2024-01-24T12:44:12.307009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296190+0000","last_change":"2024-01-24T12:44:10.934690+0000","last_active":"2024-01-24T12:44:12.296190+0000","last_peered":"2024-01-24T12:44:12.296190+0000","last_clean":"2024-01-24T12:44:12.296190+0000","last_became_active":"2024-01-24T12:44:10.934221+0000","last_became_peered":"2024-01-24T12:44:10.934221+0000","last_unstale":"2024-01-24T12:44:12.296190+0000","last_undegraded":"2024-01-24T12:44:12.296190+0000","last_fullsized":"2024-01-24T12:44:12.296190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296123+0000","last_change":"2024-01-24T12:44:11.333832+0000","last_active":"2024-01-24T12:44:12.296123+0000","last_peered":"2024-01-24T12:44:12.296123+0000","last_clean":"2024-01-24T12:44:12.296123+0000","last_became_active":"2024-01-24T12:44:11.333545+0000","last_became_peered":"2024-01-24T12:44:11.333545+0000","last_unstale":"2024-01-24T12:44:12.296123+0000","last_undegraded":"2024-01-24T12:44:12.296123+0000","last_fullsized":"2024-01-24T12:44:12.296123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307335+0000","last_change":"2024-01-24T12:44:10.950192+0000","last_active":"2024-01-24T12:44:12.307335+0000","last_peered":"2024-01-24T12:44:12.307335+0000","last_clean":"2024-01-24T12:44:12.307335+0000","last_became_active":"2024-01-24T12:44:10.949914+0000","last_became_peered":"2024-01-24T12:44:10.949914+0000","last_unstale":"2024-01-24T12:44:12.307335+0000","last_undegraded":"2024-01-24T12:44:12.307335+0000","last_fullsized":"2024-01-24T12:44:12.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:23.624 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:23.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 Processor -- start 2024-01-24T12:44:23.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 -- start start 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c9006a4c0 0x7f0c9006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c901556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900bb370 con 0x7f0c9014b540 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9006ae40 con 0x7f0c9006a4c0 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c95190640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900bc320 con 0x7f0c901532f0 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.779+0000 7f0c8e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c9006a4c0 0x7f0c9006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8ed9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0c9014b540 0x7f0c900bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40632/0 (socket says 172.21.15.27:40632) 2024-01-24T12:44:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8ed9d640 1 -- 172.21.15.27:0/906400426 learned_addr learned my addr 172.21.15.27:0/906400426 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8f59e640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c901556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8e59c640 1 -- 172.21.15.27:0/906400426 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 msgr2=0x7f0c901556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8e59c640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c901556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8e59c640 1 -- 172.21.15.27:0/906400426 >> v1:172.21.15.27:6789/0 conn(0x7f0c9014b540 legacy=0x7f0c900bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8dd9b640 1 -- 172.21.15.27:0/906400426 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818261936 0 0) 0x7f0c900bb370 con 0x7f0c9014b540 2024-01-24T12:44:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8e59c640 1 -- 172.21.15.27:0/906400426 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900bc590 con 0x7f0c9006a4c0 2024-01-24T12:44:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8e59c640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c9006a900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f10afc6e4eba80 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8dd9b640 1 -- 172.21.15.27:0/906400426 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0a8970 con 0x7f0c9006a4c0 2024-01-24T12:44:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8dd9b640 1 -- 172.21.15.27:0/906400426 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0a8ad0 con 0x7f0c9006a4c0 2024-01-24T12:44:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c8dd9b640 1 -- 172.21.15.27:0/906400426 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0a8e60 con 0x7f0c9006a4c0 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 -- 172.21.15.27:0/906400426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 msgr2=0x7f0c9006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c9006a900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0097c0 tx=0x7f0c7c01ec70 comp rx=0 tx=0).stop 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 -- 172.21.15.27:0/906400426 shutdown_connections 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c901556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 --2- 172.21.15.27:0/906400426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c9006a900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 -- 172.21.15.27:0/906400426 >> 172.21.15.27:0/906400426 conn(0x7f0c900c02e0 msgr2=0x7f0c900c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 -- 172.21.15.27:0/906400426 shutdown_connections 2024-01-24T12:44:23.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.783+0000 7f0c95190640 1 -- 172.21.15.27:0/906400426 wait complete. 2024-01-24T12:44:23.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 Processor -- start 2024-01-24T12:44:23.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- start start 2024-01-24T12:44:23.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c9014b540 0x7f0c900b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c900b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901e3a20 con 0x7f0c9006a4c0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900b3d80 con 0x7f0c9014b540 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901e3ca0 con 0x7f0c901532f0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55860/0 (socket says 172.21.15.27:55860) 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 -- 172.21.15.27:0/889562305 learned_addr learned my addr 172.21.15.27:0/889562305 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 -- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 msgr2=0x7f0c900b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c900b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 -- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c9014b540 msgr2=0x7f0c900b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c9014b540 0x7f0c900b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 -- 172.21.15.27:0/889562305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c009420 con 0x7f0c9006a4c0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8ed9d640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c520 tx=0x7f0c8000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800074e0 con 0x7f0c9006a4c0 2024-01-24T12:44:23.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80007640 con 0x7f0c9006a4c0 2024-01-24T12:44:23.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c901e4130 con 0x7f0c9006a4c0 2024-01-24T12:44:23.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800049f0 con 0x7f0c9006a4c0 2024-01-24T12:44:23.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c901468d0 con 0x7f0c9006a4c0 2024-01-24T12:44:23.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9004e000 con 0x7f0c9006a4c0 2024-01-24T12:44:23.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c80004b50 con 0x7f0c9006a4c0 2024-01-24T12:44:23.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 0x7f0c78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:23.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c80082430 con 0x7f0c9006a4c0 2024-01-24T12:44:23.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.787+0000 7f0c8e59c640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 0x7f0c78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:23.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.791+0000 7f0c8e59c640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 0x7f0c78067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0b2000 tx=0x7f0c7c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:23.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.791+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0c8004fe80 con 0x7f0c9006a4c0 2024-01-24T12:44:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.939+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c900bfa00 con 0x7f0c78065a60 2024-01-24T12:44:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.959+0000 7f0c877fe640 1 -- 172.21.15.27:0/889562305 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264412 (secure 0 0 0) 0x7f0c7c0bb440 con 0x7f0c78065a60 2024-01-24T12:44:23.963 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:23.965 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 msgr2=0x7f0c78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 0x7f0c78067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0b2000 tx=0x7f0c7c004740 comp rx=0 tx=0).stop 2024-01-24T12:44:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 msgr2=0x7f0c901e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c520 tx=0x7f0c8000c9e0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 shutdown_connections 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c78065a60 0x7f0c78067f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c901532f0 0x7f0c900b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c9014b540 0x7f0c900b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 --2- 172.21.15.27:0/889562305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9006a4c0 0x7f0c901e34e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 >> 172.21.15.27:0/889562305 conn(0x7f0c900c02e0 msgr2=0x7f0c900c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 shutdown_connections 2024-01-24T12:44:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:23.963+0000 7f0c95190640 1 -- 172.21.15.27:0/889562305 wait complete. 2024-01-24T12:44:23.980 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-24T12:44:23.624629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.331299"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310364+0000","last_change":"2024-01-24T12:44:11.346047+0000","last_active":"2024-01-24T12:44:12.310364+0000","last_peered":"2024-01-24T12:44:12.310364+0000","last_clean":"2024-01-24T12:44:12.310364+0000","last_became_active":"2024-01-24T12:44:11.345291+0000","last_became_peered":"2024-01-24T12:44:11.345291+0000","last_unstale":"2024-01-24T12:44:12.310364+0000","last_undegraded":"2024-01-24T12:44:12.310364+0000","last_fullsized":"2024-01-24T12:44:12.310364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308731+0000","last_change":"2024-01-24T12:44:11.311127+0000","last_active":"2024-01-24T12:44:12.308731+0000","last_peered":"2024-01-24T12:44:12.308731+0000","last_clean":"2024-01-24T12:44:12.308731+0000","last_became_active":"2024-01-24T12:44:11.310860+0000","last_became_peered":"2024-01-24T12:44:11.310860+0000","last_unstale":"2024-01-24T12:44:12.308731+0000","last_undegraded":"2024-01-24T12:44:12.308731+0000","last_fullsized":"2024-01-24T12:44:12.308731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306766+0000","last_change":"2024-01-24T12:44:11.304106+0000","last_active":"2024-01-24T12:44:12.306766+0000","last_peered":"2024-01-24T12:44:12.306766+0000","last_clean":"2024-01-24T12:44:12.306766+0000","last_became_active":"2024-01-24T12:44:11.303766+0000","last_became_peered":"2024-01-24T12:44:11.303766+0000","last_unstale":"2024-01-24T12:44:12.306766+0000","last_undegraded":"2024-01-24T12:44:12.306766+0000","last_fullsized":"2024-01-24T12:44:12.306766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308433+0000","last_change":"2024-01-24T12:44:11.344843+0000","last_active":"2024-01-24T12:44:12.308433+0000","last_peered":"2024-01-24T12:44:12.308433+0000","last_clean":"2024-01-24T12:44:12.308433+0000","last_became_active":"2024-01-24T12:44:11.342895+0000","last_became_peered":"2024-01-24T12:44:11.342895+0000","last_unstale":"2024-01-24T12:44:12.308433+0000","last_undegraded":"2024-01-24T12:44:12.308433+0000","last_fullsized":"2024-01-24T12:44:12.308433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309684+0000","last_change":"2024-01-24T12:44:11.350959+0000","last_active":"2024-01-24T12:44:12.309684+0000","last_peered":"2024-01-24T12:44:12.309684+0000","last_clean":"2024-01-24T12:44:12.309684+0000","last_became_active":"2024-01-24T12:44:11.350348+0000","last_became_peered":"2024-01-24T12:44:11.350348+0000","last_unstale":"2024-01-24T12:44:12.309684+0000","last_undegraded":"2024-01-24T12:44:12.309684+0000","last_fullsized":"2024-01-24T12:44:12.309684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308183+0000","last_change":"2024-01-24T12:44:11.356890+0000","last_active":"2024-01-24T12:44:12.308183+0000","last_peered":"2024-01-24T12:44:12.308183+0000","last_clean":"2024-01-24T12:44:12.308183+0000","last_became_active":"2024-01-24T12:44:11.356294+0000","last_became_peered":"2024-01-24T12:44:11.356294+0000","last_unstale":"2024-01-24T12:44:12.308183+0000","last_undegraded":"2024-01-24T12:44:12.308183+0000","last_fullsized":"2024-01-24T12:44:12.308183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308450+0000","last_change":"2024-01-24T12:44:11.338748+0000","last_active":"2024-01-24T12:44:12.308450+0000","last_peered":"2024-01-24T12:44:12.308450+0000","last_clean":"2024-01-24T12:44:12.308450+0000","last_became_active":"2024-01-24T12:44:11.337933+0000","last_became_peered":"2024-01-24T12:44:11.337933+0000","last_unstale":"2024-01-24T12:44:12.308450+0000","last_undegraded":"2024-01-24T12:44:12.308450+0000","last_fullsized":"2024-01-24T12:44:12.308450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:24:19.899018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295959+0000","last_change":"2024-01-24T12:44:11.356535+0000","last_active":"2024-01-24T12:44:12.295959+0000","last_peered":"2024-01-24T12:44:12.295959+0000","last_clean":"2024-01-24T12:44:12.295959+0000","last_became_active":"2024-01-24T12:44:11.356329+0000","last_became_peered":"2024-01-24T12:44:11.356329+0000","last_unstale":"2024-01-24T12:44:12.295959+0000","last_undegraded":"2024-01-24T12:44:12.295959+0000","last_fullsized":"2024-01-24T12:44:12.295959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310566+0000","last_change":"2024-01-24T12:44:11.358761+0000","last_active":"2024-01-24T12:44:12.310566+0000","last_peered":"2024-01-24T12:44:12.310566+0000","last_clean":"2024-01-24T12:44:12.310566+0000","last_became_active":"2024-01-24T12:44:11.358193+0000","last_became_peered":"2024-01-24T12:44:11.358193+0000","last_unstale":"2024-01-24T12:44:12.310566+0000","last_undegraded":"2024-01-24T12:44:12.310566+0000","last_fullsized":"2024-01-24T12:44:12.310566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:14:49.103179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298433+0000","last_change":"2024-01-24T12:44:11.344182+0000","last_active":"2024-01-24T12:44:12.298433+0000","last_peered":"2024-01-24T12:44:12.298433+0000","last_clean":"2024-01-24T12:44:12.298433+0000","last_became_active":"2024-01-24T12:44:11.343506+0000","last_became_peered":"2024-01-24T12:44:11.343506+0000","last_unstale":"2024-01-24T12:44:12.298433+0000","last_undegraded":"2024-01-24T12:44:12.298433+0000","last_fullsized":"2024-01-24T12:44:12.298433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297856+0000","last_change":"2024-01-24T12:44:11.356600+0000","last_active":"2024-01-24T12:44:12.297856+0000","last_peered":"2024-01-24T12:44:12.297856+0000","last_clean":"2024-01-24T12:44:12.297856+0000","last_became_active":"2024-01-24T12:44:11.355969+0000","last_became_peered":"2024-01-24T12:44:11.355969+0000","last_unstale":"2024-01-24T12:44:12.297856+0000","last_undegraded":"2024-01-24T12:44:12.297856+0000","last_fullsized":"2024-01-24T12:44:12.297856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300489+0000","last_change":"2024-01-24T12:44:11.323993+0000","last_active":"2024-01-24T12:44:12.300489+0000","last_peered":"2024-01-24T12:44:12.300489+0000","last_clean":"2024-01-24T12:44:12.300489+0000","last_became_active":"2024-01-24T12:44:11.323228+0000","last_became_peered":"2024-01-24T12:44:11.323228+0000","last_unstale":"2024-01-24T12:44:12.300489+0000","last_undegraded":"2024-01-24T12:44:12.300489+0000","last_fullsized":"2024-01-24T12:44:12.300489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296421+0000","last_change":"2024-01-24T12:44:11.333852+0000","last_active":"2024-01-24T12:44:12.296421+0000","last_peered":"2024-01-24T12:44:12.296421+0000","last_clean":"2024-01-24T12:44:12.296421+0000","last_became_active":"2024-01-24T12:44:11.333515+0000","last_became_peered":"2024-01-24T12:44:11.333515+0000","last_unstale":"2024-01-24T12:44:12.296421+0000","last_undegraded":"2024-01-24T12:44:12.296421+0000","last_fullsized":"2024-01-24T12:44:12.296421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306748+0000","last_change":"2024-01-24T12:44:11.303301+0000","last_active":"2024-01-24T12:44:12.306748+0000","last_peered":"2024-01-24T12:44:12.306748+0000","last_clean":"2024-01-24T12:44:12.306748+0000","last_became_active":"2024-01-24T12:44:11.303019+0000","last_became_peered":"2024-01-24T12:44:11.303019+0000","last_unstale":"2024-01-24T12:44:12.306748+0000","last_undegraded":"2024-01-24T12:44:12.306748+0000","last_fullsized":"2024-01-24T12:44:12.306748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:27:22.445760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307701+0000","last_change":"2024-01-24T12:44:11.335600+0000","last_active":"2024-01-24T12:44:12.307701+0000","last_peered":"2024-01-24T12:44:12.307701+0000","last_clean":"2024-01-24T12:44:12.307701+0000","last_became_active":"2024-01-24T12:44:11.335242+0000","last_became_peered":"2024-01-24T12:44:11.335242+0000","last_unstale":"2024-01-24T12:44:12.307701+0000","last_undegraded":"2024-01-24T12:44:12.307701+0000","last_fullsized":"2024-01-24T12:44:12.307701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309464+0000","last_change":"2024-01-24T12:44:11.355761+0000","last_active":"2024-01-24T12:44:12.309464+0000","last_peered":"2024-01-24T12:44:12.309464+0000","last_clean":"2024-01-24T12:44:12.309464+0000","last_became_active":"2024-01-24T12:44:11.355005+0000","last_became_peered":"2024-01-24T12:44:11.355005+0000","last_unstale":"2024-01-24T12:44:12.309464+0000","last_undegraded":"2024-01-24T12:44:12.309464+0000","last_fullsized":"2024-01-24T12:44:12.309464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309115+0000","last_change":"2024-01-24T12:44:11.342686+0000","last_active":"2024-01-24T12:44:12.309115+0000","last_peered":"2024-01-24T12:44:12.309115+0000","last_clean":"2024-01-24T12:44:12.309115+0000","last_became_active":"2024-01-24T12:44:11.341936+0000","last_became_peered":"2024-01-24T12:44:11.341936+0000","last_unstale":"2024-01-24T12:44:12.309115+0000","last_undegraded":"2024-01-24T12:44:12.309115+0000","last_fullsized":"2024-01-24T12:44:12.309115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307772+0000","last_change":"2024-01-24T12:44:11.333755+0000","last_active":"2024-01-24T12:44:12.307772+0000","last_peered":"2024-01-24T12:44:12.307772+0000","last_clean":"2024-01-24T12:44:12.307772+0000","last_became_active":"2024-01-24T12:44:11.333446+0000","last_became_peered":"2024-01-24T12:44:11.333446+0000","last_unstale":"2024-01-24T12:44:12.307772+0000","last_undegraded":"2024-01-24T12:44:12.307772+0000","last_fullsized":"2024-01-24T12:44:12.307772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:42.156108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310343+0000","last_change":"2024-01-24T12:44:11.351739+0000","last_active":"2024-01-24T12:44:12.310343+0000","last_peered":"2024-01-24T12:44:12.310343+0000","last_clean":"2024-01-24T12:44:12.310343+0000","last_became_active":"2024-01-24T12:44:11.350438+0000","last_became_peered":"2024-01-24T12:44:11.350438+0000","last_unstale":"2024-01-24T12:44:12.310343+0000","last_undegraded":"2024-01-24T12:44:12.310343+0000","last_fullsized":"2024-01-24T12:44:12.310343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:29:54.019333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297822+0000","last_change":"2024-01-24T12:44:11.328405+0000","last_active":"2024-01-24T12:44:12.297822+0000","last_peered":"2024-01-24T12:44:12.297822+0000","last_clean":"2024-01-24T12:44:12.297822+0000","last_became_active":"2024-01-24T12:44:11.327290+0000","last_became_peered":"2024-01-24T12:44:11.327290+0000","last_unstale":"2024-01-24T12:44:12.297822+0000","last_undegraded":"2024-01-24T12:44:12.297822+0000","last_fullsized":"2024-01-24T12:44:12.297822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307157+0000","last_change":"2024-01-24T12:44:11.338647+0000","last_active":"2024-01-24T12:44:12.307157+0000","last_peered":"2024-01-24T12:44:12.307157+0000","last_clean":"2024-01-24T12:44:12.307157+0000","last_became_active":"2024-01-24T12:44:11.338384+0000","last_became_peered":"2024-01-24T12:44:11.338384+0000","last_unstale":"2024-01-24T12:44:12.307157+0000","last_undegraded":"2024-01-24T12:44:12.307157+0000","last_fullsized":"2024-01-24T12:44:12.307157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308232+0000","last_change":"2024-01-24T12:44:11.355653+0000","last_active":"2024-01-24T12:44:12.308232+0000","last_peered":"2024-01-24T12:44:12.308232+0000","last_clean":"2024-01-24T12:44:12.308232+0000","last_became_active":"2024-01-24T12:44:11.354823+0000","last_became_peered":"2024-01-24T12:44:11.354823+0000","last_unstale":"2024-01-24T12:44:12.308232+0000","last_undegraded":"2024-01-24T12:44:12.308232+0000","last_fullsized":"2024-01-24T12:44:12.308232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296174+0000","last_change":"2024-01-24T12:44:11.323202+0000","last_active":"2024-01-24T12:44:12.296174+0000","last_peered":"2024-01-24T12:44:12.296174+0000","last_clean":"2024-01-24T12:44:12.296174+0000","last_became_active":"2024-01-24T12:44:11.322874+0000","last_became_peered":"2024-01-24T12:44:11.322874+0000","last_unstale":"2024-01-24T12:44:12.296174+0000","last_undegraded":"2024-01-24T12:44:12.296174+0000","last_fullsized":"2024-01-24T12:44:12.296174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308180+0000","last_change":"2024-01-24T12:44:11.354498+0000","last_active":"2024-01-24T12:44:12.308180+0000","last_peered":"2024-01-24T12:44:12.308180+0000","last_clean":"2024-01-24T12:44:12.308180+0000","last_became_active":"2024-01-24T12:44:11.353885+0000","last_became_peered":"2024-01-24T12:44:11.353885+0000","last_unstale":"2024-01-24T12:44:12.308180+0000","last_undegraded":"2024-01-24T12:44:12.308180+0000","last_fullsized":"2024-01-24T12:44:12.308180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:55:19.475476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296059+0000","last_change":"2024-01-24T12:44:11.326023+0000","last_active":"2024-01-24T12:44:12.296059+0000","last_peered":"2024-01-24T12:44:12.296059+0000","last_clean":"2024-01-24T12:44:12.296059+0000","last_became_active":"2024-01-24T12:44:11.325817+0000","last_became_peered":"2024-01-24T12:44:11.325817+0000","last_unstale":"2024-01-24T12:44:12.296059+0000","last_undegraded":"2024-01-24T12:44:12.296059+0000","last_fullsized":"2024-01-24T12:44:12.296059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298514+0000","last_change":"2024-01-24T12:44:11.340890+0000","last_active":"2024-01-24T12:44:12.298514+0000","last_peered":"2024-01-24T12:44:12.298514+0000","last_clean":"2024-01-24T12:44:12.298514+0000","last_became_active":"2024-01-24T12:44:11.340032+0000","last_became_peered":"2024-01-24T12:44:11.340032+0000","last_unstale":"2024-01-24T12:44:12.298514+0000","last_undegraded":"2024-01-24T12:44:12.298514+0000","last_fullsized":"2024-01-24T12:44:12.298514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308552+0000","last_change":"2024-01-24T12:44:11.304881+0000","last_active":"2024-01-24T12:44:12.308552+0000","last_peered":"2024-01-24T12:44:12.308552+0000","last_clean":"2024-01-24T12:44:12.308552+0000","last_became_active":"2024-01-24T12:44:11.304584+0000","last_became_peered":"2024-01-24T12:44:11.304584+0000","last_unstale":"2024-01-24T12:44:12.308552+0000","last_undegraded":"2024-01-24T12:44:12.308552+0000","last_fullsized":"2024-01-24T12:44:12.308552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296302+0000","last_change":"2024-01-24T12:44:11.325073+0000","last_active":"2024-01-24T12:44:12.296302+0000","last_peered":"2024-01-24T12:44:12.296302+0000","last_clean":"2024-01-24T12:44:12.296302+0000","last_became_active":"2024-01-24T12:44:11.324807+0000","last_became_peered":"2024-01-24T12:44:11.324807+0000","last_unstale":"2024-01-24T12:44:12.296302+0000","last_undegraded":"2024-01-24T12:44:12.296302+0000","last_fullsized":"2024-01-24T12:44:12.296302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307195+0000","last_change":"2024-01-24T12:44:11.303436+0000","last_active":"2024-01-24T12:44:12.307195+0000","last_peered":"2024-01-24T12:44:12.307195+0000","last_clean":"2024-01-24T12:44:12.307195+0000","last_became_active":"2024-01-24T12:44:11.303191+0000","last_became_peered":"2024-01-24T12:44:11.303191+0000","last_unstale":"2024-01-24T12:44:12.307195+0000","last_undegraded":"2024-01-24T12:44:12.307195+0000","last_fullsized":"2024-01-24T12:44:12.307195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308464+0000","last_change":"2024-01-24T12:44:11.355739+0000","last_active":"2024-01-24T12:44:12.308464+0000","last_peered":"2024-01-24T12:44:12.308464+0000","last_clean":"2024-01-24T12:44:12.308464+0000","last_became_active":"2024-01-24T12:44:11.354956+0000","last_became_peered":"2024-01-24T12:44:11.354956+0000","last_unstale":"2024-01-24T12:44:12.308464+0000","last_undegraded":"2024-01-24T12:44:12.308464+0000","last_fullsized":"2024-01-24T12:44:12.308464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:19:40.142802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307893+0000","last_change":"2024-01-24T12:44:11.341356+0000","last_active":"2024-01-24T12:44:12.307893+0000","last_peered":"2024-01-24T12:44:12.307893+0000","last_clean":"2024-01-24T12:44:12.307893+0000","last_became_active":"2024-01-24T12:44:11.341002+0000","last_became_peered":"2024-01-24T12:44:11.341002+0000","last_unstale":"2024-01-24T12:44:12.307893+0000","last_undegraded":"2024-01-24T12:44:12.307893+0000","last_fullsized":"2024-01-24T12:44:12.307893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297329+0000","last_change":"2024-01-24T12:44:11.318461+0000","last_active":"2024-01-24T12:44:12.297329+0000","last_peered":"2024-01-24T12:44:12.297329+0000","last_clean":"2024-01-24T12:44:12.297329+0000","last_became_active":"2024-01-24T12:44:11.317738+0000","last_became_peered":"2024-01-24T12:44:11.317738+0000","last_unstale":"2024-01-24T12:44:12.297329+0000","last_undegraded":"2024-01-24T12:44:12.297329+0000","last_fullsized":"2024-01-24T12:44:12.297329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299592+0000","last_change":"2024-01-24T12:44:11.324214+0000","last_active":"2024-01-24T12:44:12.299592+0000","last_peered":"2024-01-24T12:44:12.299592+0000","last_clean":"2024-01-24T12:44:12.299592+0000","last_became_active":"2024-01-24T12:44:11.323445+0000","last_became_peered":"2024-01-24T12:44:11.323445+0000","last_unstale":"2024-01-24T12:44:12.299592+0000","last_undegraded":"2024-01-24T12:44:12.299592+0000","last_fullsized":"2024-01-24T12:44:12.299592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:47.789349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296576+0000","last_change":"2024-01-24T12:44:10.955244+0000","last_active":"2024-01-24T12:44:12.296576+0000","last_peered":"2024-01-24T12:44:12.296576+0000","last_clean":"2024-01-24T12:44:12.296576+0000","last_became_active":"2024-01-24T12:44:10.954900+0000","last_became_peered":"2024-01-24T12:44:10.954900+0000","last_unstale":"2024-01-24T12:44:12.296576+0000","last_undegraded":"2024-01-24T12:44:12.296576+0000","last_fullsized":"2024-01-24T12:44:12.296576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307282+0000","last_change":"2024-01-24T12:44:11.322525+0000","last_active":"2024-01-24T12:44:12.307282+0000","last_peered":"2024-01-24T12:44:12.307282+0000","last_clean":"2024-01-24T12:44:12.307282+0000","last_became_active":"2024-01-24T12:44:11.322196+0000","last_became_peered":"2024-01-24T12:44:11.322196+0000","last_unstale":"2024-01-24T12:44:12.307282+0000","last_undegraded":"2024-01-24T12:44:12.307282+0000","last_fullsized":"2024-01-24T12:44:12.307282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297693+0000","last_change":"2024-01-24T12:44:10.938016+0000","last_active":"2024-01-24T12:44:12.297693+0000","last_peered":"2024-01-24T12:44:12.297693+0000","last_clean":"2024-01-24T12:44:12.297693+0000","last_became_active":"2024-01-24T12:44:10.937051+0000","last_became_peered":"2024-01-24T12:44:10.937051+0000","last_unstale":"2024-01-24T12:44:12.297693+0000","last_undegraded":"2024-01-24T12:44:12.297693+0000","last_fullsized":"2024-01-24T12:44:12.297693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296065+0000","last_change":"2024-01-24T12:44:10.944973+0000","last_active":"2024-01-24T12:44:12.296065+0000","last_peered":"2024-01-24T12:44:12.296065+0000","last_clean":"2024-01-24T12:44:12.296065+0000","last_became_active":"2024-01-24T12:44:10.944391+0000","last_became_peered":"2024-01-24T12:44:10.944391+0000","last_unstale":"2024-01-24T12:44:12.296065+0000","last_undegraded":"2024-01-24T12:44:12.296065+0000","last_fullsized":"2024-01-24T12:44:12.296065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296241+0000","last_change":"2024-01-24T12:44:11.306739+0000","last_active":"2024-01-24T12:44:12.296241+0000","last_peered":"2024-01-24T12:44:12.296241+0000","last_clean":"2024-01-24T12:44:12.296241+0000","last_became_active":"2024-01-24T12:44:11.306515+0000","last_became_peered":"2024-01-24T12:44:11.306515+0000","last_unstale":"2024-01-24T12:44:12.296241+0000","last_undegraded":"2024-01-24T12:44:12.296241+0000","last_fullsized":"2024-01-24T12:44:12.296241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308408+0000","last_change":"2024-01-24T12:44:10.937679+0000","last_active":"2024-01-24T12:44:12.308408+0000","last_peered":"2024-01-24T12:44:12.308408+0000","last_clean":"2024-01-24T12:44:12.308408+0000","last_became_active":"2024-01-24T12:44:10.936808+0000","last_became_peered":"2024-01-24T12:44:10.936808+0000","last_unstale":"2024-01-24T12:44:12.308408+0000","last_undegraded":"2024-01-24T12:44:12.308408+0000","last_fullsized":"2024-01-24T12:44:12.308408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307614+0000","last_change":"2024-01-24T12:44:11.305203+0000","last_active":"2024-01-24T12:44:12.307614+0000","last_peered":"2024-01-24T12:44:12.307614+0000","last_clean":"2024-01-24T12:44:12.307614+0000","last_became_active":"2024-01-24T12:44:11.304919+0000","last_became_peered":"2024-01-24T12:44:11.304919+0000","last_unstale":"2024-01-24T12:44:12.307614+0000","last_undegraded":"2024-01-24T12:44:12.307614+0000","last_fullsized":"2024-01-24T12:44:12.307614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298446+0000","last_change":"2024-01-24T12:44:10.949242+0000","last_active":"2024-01-24T12:44:12.298446+0000","last_peered":"2024-01-24T12:44:12.298446+0000","last_clean":"2024-01-24T12:44:12.298446+0000","last_became_active":"2024-01-24T12:44:10.948044+0000","last_became_peered":"2024-01-24T12:44:10.948044+0000","last_unstale":"2024-01-24T12:44:12.298446+0000","last_undegraded":"2024-01-24T12:44:12.298446+0000","last_fullsized":"2024-01-24T12:44:12.298446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308948+0000","last_change":"2024-01-24T12:44:11.346554+0000","last_active":"2024-01-24T12:44:12.308948+0000","last_peered":"2024-01-24T12:44:12.308948+0000","last_clean":"2024-01-24T12:44:12.308948+0000","last_became_active":"2024-01-24T12:44:11.345775+0000","last_became_peered":"2024-01-24T12:44:11.345775+0000","last_unstale":"2024-01-24T12:44:12.308948+0000","last_undegraded":"2024-01-24T12:44:12.308948+0000","last_fullsized":"2024-01-24T12:44:12.308948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309141+0000","last_change":"2024-01-24T12:44:10.944636+0000","last_active":"2024-01-24T12:44:12.309141+0000","last_peered":"2024-01-24T12:44:12.309141+0000","last_clean":"2024-01-24T12:44:12.309141+0000","last_became_active":"2024-01-24T12:44:10.943901+0000","last_became_peered":"2024-01-24T12:44:10.943901+0000","last_unstale":"2024-01-24T12:44:12.309141+0000","last_undegraded":"2024-01-24T12:44:12.309141+0000","last_fullsized":"2024-01-24T12:44:12.309141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307177+0000","last_change":"2024-01-24T12:44:11.343815+0000","last_active":"2024-01-24T12:44:12.307177+0000","last_peered":"2024-01-24T12:44:12.307177+0000","last_clean":"2024-01-24T12:44:12.307177+0000","last_became_active":"2024-01-24T12:44:11.343536+0000","last_became_peered":"2024-01-24T12:44:11.343536+0000","last_unstale":"2024-01-24T12:44:12.307177+0000","last_undegraded":"2024-01-24T12:44:12.307177+0000","last_fullsized":"2024-01-24T12:44:12.307177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.948117+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.947825+0000","last_became_peered":"2024-01-24T12:44:10.947825+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300676+0000","last_change":"2024-01-24T12:44:11.340824+0000","last_active":"2024-01-24T12:44:12.300676+0000","last_peered":"2024-01-24T12:44:12.300676+0000","last_clean":"2024-01-24T12:44:12.300676+0000","last_became_active":"2024-01-24T12:44:11.340194+0000","last_became_peered":"2024-01-24T12:44:11.340194+0000","last_unstale":"2024-01-24T12:44:12.300676+0000","last_undegraded":"2024-01-24T12:44:12.300676+0000","last_fullsized":"2024-01-24T12:44:12.300676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297929+0000","last_change":"2024-01-24T12:44:10.932460+0000","last_active":"2024-01-24T12:44:12.297929+0000","last_peered":"2024-01-24T12:44:12.297929+0000","last_clean":"2024-01-24T12:44:12.297929+0000","last_became_active":"2024-01-24T12:44:10.931678+0000","last_became_peered":"2024-01-24T12:44:10.931678+0000","last_unstale":"2024-01-24T12:44:12.297929+0000","last_undegraded":"2024-01-24T12:44:12.297929+0000","last_fullsized":"2024-01-24T12:44:12.297929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310013+0000","last_change":"2024-01-24T12:44:11.338493+0000","last_active":"2024-01-24T12:44:12.310013+0000","last_peered":"2024-01-24T12:44:12.310013+0000","last_clean":"2024-01-24T12:44:12.310013+0000","last_became_active":"2024-01-24T12:44:11.337805+0000","last_became_peered":"2024-01-24T12:44:11.337805+0000","last_unstale":"2024-01-24T12:44:12.310013+0000","last_undegraded":"2024-01-24T12:44:12.310013+0000","last_fullsized":"2024-01-24T12:44:12.310013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:43:01.538446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307465+0000","last_change":"2024-01-24T12:44:10.948122+0000","last_active":"2024-01-24T12:44:12.307465+0000","last_peered":"2024-01-24T12:44:12.307465+0000","last_clean":"2024-01-24T12:44:12.307465+0000","last_became_active":"2024-01-24T12:44:10.947868+0000","last_became_peered":"2024-01-24T12:44:10.947868+0000","last_unstale":"2024-01-24T12:44:12.307465+0000","last_undegraded":"2024-01-24T12:44:12.307465+0000","last_fullsized":"2024-01-24T12:44:12.307465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306691+0000","last_change":"2024-01-24T12:44:11.338719+0000","last_active":"2024-01-24T12:44:12.306691+0000","last_peered":"2024-01-24T12:44:12.306691+0000","last_clean":"2024-01-24T12:44:12.306691+0000","last_became_active":"2024-01-24T12:44:11.338420+0000","last_became_peered":"2024-01-24T12:44:11.338420+0000","last_unstale":"2024-01-24T12:44:12.306691+0000","last_undegraded":"2024-01-24T12:44:12.306691+0000","last_fullsized":"2024-01-24T12:44:12.306691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308469+0000","last_change":"2024-01-24T12:44:10.942141+0000","last_active":"2024-01-24T12:44:12.308469+0000","last_peered":"2024-01-24T12:44:12.308469+0000","last_clean":"2024-01-24T12:44:12.308469+0000","last_became_active":"2024-01-24T12:44:10.940912+0000","last_became_peered":"2024-01-24T12:44:10.940912+0000","last_unstale":"2024-01-24T12:44:12.308469+0000","last_undegraded":"2024-01-24T12:44:12.308469+0000","last_fullsized":"2024-01-24T12:44:12.308469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309938+0000","last_change":"2024-01-24T12:44:11.351939+0000","last_active":"2024-01-24T12:44:12.309938+0000","last_peered":"2024-01-24T12:44:12.309938+0000","last_clean":"2024-01-24T12:44:12.309938+0000","last_became_active":"2024-01-24T12:44:11.351433+0000","last_became_peered":"2024-01-24T12:44:11.351433+0000","last_unstale":"2024-01-24T12:44:12.309938+0000","last_undegraded":"2024-01-24T12:44:12.309938+0000","last_fullsized":"2024-01-24T12:44:12.309938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:38:47.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297489+0000","last_change":"2024-01-24T12:44:10.937971+0000","last_active":"2024-01-24T12:44:12.297489+0000","last_peered":"2024-01-24T12:44:12.297489+0000","last_clean":"2024-01-24T12:44:12.297489+0000","last_became_active":"2024-01-24T12:44:10.937130+0000","last_became_peered":"2024-01-24T12:44:10.937130+0000","last_unstale":"2024-01-24T12:44:12.297489+0000","last_undegraded":"2024-01-24T12:44:12.297489+0000","last_fullsized":"2024-01-24T12:44:12.297489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297341+0000","last_change":"2024-01-24T12:44:11.317998+0000","last_active":"2024-01-24T12:44:12.297341+0000","last_peered":"2024-01-24T12:44:12.297341+0000","last_clean":"2024-01-24T12:44:12.297341+0000","last_became_active":"2024-01-24T12:44:11.313220+0000","last_became_peered":"2024-01-24T12:44:11.313220+0000","last_unstale":"2024-01-24T12:44:12.297341+0000","last_undegraded":"2024-01-24T12:44:12.297341+0000","last_fullsized":"2024-01-24T12:44:12.297341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307832+0000","last_change":"2024-01-24T12:44:10.935739+0000","last_active":"2024-01-24T12:44:12.307832+0000","last_peered":"2024-01-24T12:44:12.307832+0000","last_clean":"2024-01-24T12:44:12.307832+0000","last_became_active":"2024-01-24T12:44:10.935329+0000","last_became_peered":"2024-01-24T12:44:10.935329+0000","last_unstale":"2024-01-24T12:44:12.307832+0000","last_undegraded":"2024-01-24T12:44:12.307832+0000","last_fullsized":"2024-01-24T12:44:12.307832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309364+0000","last_change":"2024-01-24T12:44:11.344235+0000","last_active":"2024-01-24T12:44:12.309364+0000","last_peered":"2024-01-24T12:44:12.309364+0000","last_clean":"2024-01-24T12:44:12.309364+0000","last_became_active":"2024-01-24T12:44:11.343638+0000","last_became_peered":"2024-01-24T12:44:11.343638+0000","last_unstale":"2024-01-24T12:44:12.309364+0000","last_undegraded":"2024-01-24T12:44:12.309364+0000","last_fullsized":"2024-01-24T12:44:12.309364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:30:43.676453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300535+0000","last_change":"2024-01-24T12:44:10.934962+0000","last_active":"2024-01-24T12:44:12.300535+0000","last_peered":"2024-01-24T12:44:12.300535+0000","last_clean":"2024-01-24T12:44:12.300535+0000","last_became_active":"2024-01-24T12:44:10.934179+0000","last_became_peered":"2024-01-24T12:44:10.934179+0000","last_unstale":"2024-01-24T12:44:12.300535+0000","last_undegraded":"2024-01-24T12:44:12.300535+0000","last_fullsized":"2024-01-24T12:44:12.300535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310395+0000","last_change":"2024-01-24T12:44:11.345146+0000","last_active":"2024-01-24T12:44:12.310395+0000","last_peered":"2024-01-24T12:44:12.310395+0000","last_clean":"2024-01-24T12:44:12.310395+0000","last_became_active":"2024-01-24T12:44:11.343454+0000","last_became_peered":"2024-01-24T12:44:11.343454+0000","last_unstale":"2024-01-24T12:44:12.310395+0000","last_undegraded":"2024-01-24T12:44:12.310395+0000","last_fullsized":"2024-01-24T12:44:12.310395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:45:06.184578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308221+0000","last_change":"2024-01-24T12:44:10.941647+0000","last_active":"2024-01-24T12:44:12.308221+0000","last_peered":"2024-01-24T12:44:12.308221+0000","last_clean":"2024-01-24T12:44:12.308221+0000","last_became_active":"2024-01-24T12:44:10.941177+0000","last_became_peered":"2024-01-24T12:44:10.941177+0000","last_unstale":"2024-01-24T12:44:12.308221+0000","last_undegraded":"2024-01-24T12:44:12.308221+0000","last_fullsized":"2024-01-24T12:44:12.308221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310690+0000","last_change":"2024-01-24T12:44:11.350856+0000","last_active":"2024-01-24T12:44:12.310690+0000","last_peered":"2024-01-24T12:44:12.310690+0000","last_clean":"2024-01-24T12:44:12.310690+0000","last_became_active":"2024-01-24T12:44:11.350244+0000","last_became_peered":"2024-01-24T12:44:11.350244+0000","last_unstale":"2024-01-24T12:44:12.310690+0000","last_undegraded":"2024-01-24T12:44:12.310690+0000","last_fullsized":"2024-01-24T12:44:12.310690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:31:04.636860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308635+0000","last_change":"2024-01-24T12:44:10.937540+0000","last_active":"2024-01-24T12:44:12.308635+0000","last_peered":"2024-01-24T12:44:12.308635+0000","last_clean":"2024-01-24T12:44:12.308635+0000","last_became_active":"2024-01-24T12:44:10.937246+0000","last_became_peered":"2024-01-24T12:44:10.937246+0000","last_unstale":"2024-01-24T12:44:12.308635+0000","last_undegraded":"2024-01-24T12:44:12.308635+0000","last_fullsized":"2024-01-24T12:44:12.308635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309138+0000","last_change":"2024-01-24T12:44:11.345714+0000","last_active":"2024-01-24T12:44:12.309138+0000","last_peered":"2024-01-24T12:44:12.309138+0000","last_clean":"2024-01-24T12:44:12.309138+0000","last_became_active":"2024-01-24T12:44:11.340127+0000","last_became_peered":"2024-01-24T12:44:11.340127+0000","last_unstale":"2024-01-24T12:44:12.309138+0000","last_undegraded":"2024-01-24T12:44:12.309138+0000","last_fullsized":"2024-01-24T12:44:12.309138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307978+0000","last_change":"2024-01-24T12:44:10.946919+0000","last_active":"2024-01-24T12:44:12.307978+0000","last_peered":"2024-01-24T12:44:12.307978+0000","last_clean":"2024-01-24T12:44:12.307978+0000","last_became_active":"2024-01-24T12:44:10.946607+0000","last_became_peered":"2024-01-24T12:44:10.946607+0000","last_unstale":"2024-01-24T12:44:12.307978+0000","last_undegraded":"2024-01-24T12:44:12.307978+0000","last_fullsized":"2024-01-24T12:44:12.307978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310112+0000","last_change":"2024-01-24T12:44:11.357380+0000","last_active":"2024-01-24T12:44:12.310112+0000","last_peered":"2024-01-24T12:44:12.310112+0000","last_clean":"2024-01-24T12:44:12.310112+0000","last_became_active":"2024-01-24T12:44:11.356720+0000","last_became_peered":"2024-01-24T12:44:11.356720+0000","last_unstale":"2024-01-24T12:44:12.310112+0000","last_undegraded":"2024-01-24T12:44:12.310112+0000","last_fullsized":"2024-01-24T12:44:12.310112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:01:59.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-24T12:44:11.307644+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:11.307644+0000","last_peered":"2024-01-24T12:44:11.307644+0000","last_clean":"2024-01-24T12:44:11.307644+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:11.307644+0000","last_undegraded":"2024-01-24T12:44:11.307644+0000","last_fullsized":"2024-01-24T12:44:11.307644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309210+0000","last_change":"2024-01-24T12:44:10.932841+0000","last_active":"2024-01-24T12:44:12.309210+0000","last_peered":"2024-01-24T12:44:12.309210+0000","last_clean":"2024-01-24T12:44:12.309210+0000","last_became_active":"2024-01-24T12:44:10.931862+0000","last_became_peered":"2024-01-24T12:44:10.931862+0000","last_unstale":"2024-01-24T12:44:12.309210+0000","last_undegraded":"2024-01-24T12:44:12.309210+0000","last_fullsized":"2024-01-24T12:44:12.309210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:13:16.896571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.295950+0000","last_change":"2024-01-24T12:44:11.356544+0000","last_active":"2024-01-24T12:44:12.295950+0000","last_peered":"2024-01-24T12:44:12.295950+0000","last_clean":"2024-01-24T12:44:12.295950+0000","last_became_active":"2024-01-24T12:44:11.356289+0000","last_became_peered":"2024-01-24T12:44:11.356289+0000","last_unstale":"2024-01-24T12:44:12.295950+0000","last_undegraded":"2024-01-24T12:44:12.295950+0000","last_fullsized":"2024-01-24T12:44:12.295950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308645+0000","last_change":"2024-01-24T12:44:10.954636+0000","last_active":"2024-01-24T12:44:12.308645+0000","last_peered":"2024-01-24T12:44:12.308645+0000","last_clean":"2024-01-24T12:44:12.308645+0000","last_became_active":"2024-01-24T12:44:10.953755+0000","last_became_peered":"2024-01-24T12:44:10.953755+0000","last_unstale":"2024-01-24T12:44:12.308645+0000","last_undegraded":"2024-01-24T12:44:12.308645+0000","last_fullsized":"2024-01-24T12:44:12.308645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:39:09.640230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.306843+0000","last_change":"2024-01-24T12:44:11.322569+0000","last_active":"2024-01-24T12:44:12.306843+0000","last_peered":"2024-01-24T12:44:12.306843+0000","last_clean":"2024-01-24T12:44:12.306843+0000","last_became_active":"2024-01-24T12:44:11.322253+0000","last_became_peered":"2024-01-24T12:44:11.322253+0000","last_unstale":"2024-01-24T12:44:12.306843+0000","last_undegraded":"2024-01-24T12:44:12.306843+0000","last_fullsized":"2024-01-24T12:44:12.306843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308008+0000","last_change":"2024-01-24T12:44:10.941900+0000","last_active":"2024-01-24T12:44:12.308008+0000","last_peered":"2024-01-24T12:44:12.308008+0000","last_clean":"2024-01-24T12:44:12.308008+0000","last_became_active":"2024-01-24T12:44:10.941526+0000","last_became_peered":"2024-01-24T12:44:10.941526+0000","last_unstale":"2024-01-24T12:44:12.308008+0000","last_undegraded":"2024-01-24T12:44:12.308008+0000","last_fullsized":"2024-01-24T12:44:12.308008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307635+0000","last_change":"2024-01-24T12:44:11.306700+0000","last_active":"2024-01-24T12:44:12.307635+0000","last_peered":"2024-01-24T12:44:12.307635+0000","last_clean":"2024-01-24T12:44:12.307635+0000","last_became_active":"2024-01-24T12:44:11.306420+0000","last_became_peered":"2024-01-24T12:44:11.306420+0000","last_unstale":"2024-01-24T12:44:12.307635+0000","last_undegraded":"2024-01-24T12:44:12.307635+0000","last_fullsized":"2024-01-24T12:44:12.307635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:59:39.853440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308705+0000","last_change":"2024-01-24T12:44:10.939127+0000","last_active":"2024-01-24T12:44:12.308705+0000","last_peered":"2024-01-24T12:44:12.308705+0000","last_clean":"2024-01-24T12:44:12.308705+0000","last_became_active":"2024-01-24T12:44:10.936034+0000","last_became_peered":"2024-01-24T12:44:10.936034+0000","last_unstale":"2024-01-24T12:44:12.308705+0000","last_undegraded":"2024-01-24T12:44:12.308705+0000","last_fullsized":"2024-01-24T12:44:12.308705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.300705+0000","last_change":"2024-01-24T12:44:11.326553+0000","last_active":"2024-01-24T12:44:12.300705+0000","last_peered":"2024-01-24T12:44:12.300705+0000","last_clean":"2024-01-24T12:44:12.300705+0000","last_became_active":"2024-01-24T12:44:11.322735+0000","last_became_peered":"2024-01-24T12:44:11.322735+0000","last_unstale":"2024-01-24T12:44:12.300705+0000","last_undegraded":"2024-01-24T12:44:12.300705+0000","last_fullsized":"2024-01-24T12:44:12.300705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:38.689783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308725+0000","last_change":"2024-01-24T12:44:10.932249+0000","last_active":"2024-01-24T12:44:12.308725+0000","last_peered":"2024-01-24T12:44:12.308725+0000","last_clean":"2024-01-24T12:44:12.308725+0000","last_became_active":"2024-01-24T12:44:10.931916+0000","last_became_peered":"2024-01-24T12:44:10.931916+0000","last_unstale":"2024-01-24T12:44:12.308725+0000","last_undegraded":"2024-01-24T12:44:12.308725+0000","last_fullsized":"2024-01-24T12:44:12.308725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:13:15.337240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308828+0000","last_change":"2024-01-24T12:44:11.341472+0000","last_active":"2024-01-24T12:44:12.308828+0000","last_peered":"2024-01-24T12:44:12.308828+0000","last_clean":"2024-01-24T12:44:12.308828+0000","last_became_active":"2024-01-24T12:44:11.339574+0000","last_became_peered":"2024-01-24T12:44:11.339574+0000","last_unstale":"2024-01-24T12:44:12.308828+0000","last_undegraded":"2024-01-24T12:44:12.308828+0000","last_fullsized":"2024-01-24T12:44:12.308828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:25:05.105559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310484+0000","last_change":"2024-01-24T12:44:10.954824+0000","last_active":"2024-01-24T12:44:12.310484+0000","last_peered":"2024-01-24T12:44:12.310484+0000","last_clean":"2024-01-24T12:44:12.310484+0000","last_became_active":"2024-01-24T12:44:10.953995+0000","last_became_peered":"2024-01-24T12:44:10.953995+0000","last_unstale":"2024-01-24T12:44:12.310484+0000","last_undegraded":"2024-01-24T12:44:12.310484+0000","last_fullsized":"2024-01-24T12:44:12.310484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:49:46.778299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308748+0000","last_change":"2024-01-24T12:44:11.306822+0000","last_active":"2024-01-24T12:44:12.308748+0000","last_peered":"2024-01-24T12:44:12.308748+0000","last_clean":"2024-01-24T12:44:12.308748+0000","last_became_active":"2024-01-24T12:44:11.306582+0000","last_became_peered":"2024-01-24T12:44:11.306582+0000","last_unstale":"2024-01-24T12:44:12.308748+0000","last_undegraded":"2024-01-24T12:44:12.308748+0000","last_fullsized":"2024-01-24T12:44:12.308748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:04.584711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:14.661252+0000","last_change":"2024-01-24T12:44:10.945081+0000","last_active":"2024-01-24T12:44:14.661252+0000","last_peered":"2024-01-24T12:44:14.661252+0000","last_clean":"2024-01-24T12:44:14.661252+0000","last_became_active":"2024-01-24T12:44:10.944818+0000","last_became_peered":"2024-01-24T12:44:10.944818+0000","last_unstale":"2024-01-24T12:44:14.661252+0000","last_undegraded":"2024-01-24T12:44:14.661252+0000","last_fullsized":"2024-01-24T12:44:14.661252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:46:14.532754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296235+0000","last_change":"2024-01-24T12:44:11.338803+0000","last_active":"2024-01-24T12:44:12.296235+0000","last_peered":"2024-01-24T12:44:12.296235+0000","last_clean":"2024-01-24T12:44:12.296235+0000","last_became_active":"2024-01-24T12:44:11.338477+0000","last_became_peered":"2024-01-24T12:44:11.338477+0000","last_unstale":"2024-01-24T12:44:12.296235+0000","last_undegraded":"2024-01-24T12:44:12.296235+0000","last_fullsized":"2024-01-24T12:44:12.296235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:15.630762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.298588+0000","last_change":"2024-01-24T12:44:10.939339+0000","last_active":"2024-01-24T12:44:12.298588+0000","last_peered":"2024-01-24T12:44:12.298588+0000","last_clean":"2024-01-24T12:44:12.298588+0000","last_became_active":"2024-01-24T12:44:10.938406+0000","last_became_peered":"2024-01-24T12:44:10.938406+0000","last_unstale":"2024-01-24T12:44:12.298588+0000","last_undegraded":"2024-01-24T12:44:12.298588+0000","last_fullsized":"2024-01-24T12:44:12.298588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:08:08.209155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307008+0000","last_change":"2024-01-24T12:44:11.302425+0000","last_active":"2024-01-24T12:44:12.307008+0000","last_peered":"2024-01-24T12:44:12.307008+0000","last_clean":"2024-01-24T12:44:12.307008+0000","last_became_active":"2024-01-24T12:44:11.302126+0000","last_became_peered":"2024-01-24T12:44:11.302126+0000","last_unstale":"2024-01-24T12:44:12.307008+0000","last_undegraded":"2024-01-24T12:44:12.307008+0000","last_fullsized":"2024-01-24T12:44:12.307008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:07.654372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308420+0000","last_change":"2024-01-24T12:44:10.954419+0000","last_active":"2024-01-24T12:44:12.308420+0000","last_peered":"2024-01-24T12:44:12.308420+0000","last_clean":"2024-01-24T12:44:12.308420+0000","last_became_active":"2024-01-24T12:44:10.953740+0000","last_became_peered":"2024-01-24T12:44:10.953740+0000","last_unstale":"2024-01-24T12:44:12.308420+0000","last_undegraded":"2024-01-24T12:44:12.308420+0000","last_fullsized":"2024-01-24T12:44:12.308420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:40:41.145058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.299297+0000","last_change":"2024-01-24T12:44:11.323414+0000","last_active":"2024-01-24T12:44:12.299297+0000","last_peered":"2024-01-24T12:44:12.299297+0000","last_clean":"2024-01-24T12:44:12.299297+0000","last_became_active":"2024-01-24T12:44:11.321676+0000","last_became_peered":"2024-01-24T12:44:11.321676+0000","last_unstale":"2024-01-24T12:44:12.299297+0000","last_undegraded":"2024-01-24T12:44:12.299297+0000","last_fullsized":"2024-01-24T12:44:12.299297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:24.995947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308370+0000","last_change":"2024-01-24T12:44:10.932826+0000","last_active":"2024-01-24T12:44:12.308370+0000","last_peered":"2024-01-24T12:44:12.308370+0000","last_clean":"2024-01-24T12:44:12.308370+0000","last_became_active":"2024-01-24T12:44:10.931858+0000","last_became_peered":"2024-01-24T12:44:10.931858+0000","last_unstale":"2024-01-24T12:44:12.308370+0000","last_undegraded":"2024-01-24T12:44:12.308370+0000","last_fullsized":"2024-01-24T12:44:12.308370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:29.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296392+0000","last_change":"2024-01-24T12:44:11.305338+0000","last_active":"2024-01-24T12:44:12.296392+0000","last_peered":"2024-01-24T12:44:12.296392+0000","last_clean":"2024-01-24T12:44:12.296392+0000","last_became_active":"2024-01-24T12:44:11.305113+0000","last_became_peered":"2024-01-24T12:44:11.305113+0000","last_unstale":"2024-01-24T12:44:12.296392+0000","last_undegraded":"2024-01-24T12:44:12.296392+0000","last_fullsized":"2024-01-24T12:44:12.296392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:44:53.287938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308535+0000","last_change":"2024-01-24T12:44:10.943496+0000","last_active":"2024-01-24T12:44:12.308535+0000","last_peered":"2024-01-24T12:44:12.308535+0000","last_clean":"2024-01-24T12:44:12.308535+0000","last_became_active":"2024-01-24T12:44:10.943191+0000","last_became_peered":"2024-01-24T12:44:10.943191+0000","last_unstale":"2024-01-24T12:44:12.308535+0000","last_undegraded":"2024-01-24T12:44:12.308535+0000","last_fullsized":"2024-01-24T12:44:12.308535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:36:06.137343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296559+0000","last_change":"2024-01-24T12:44:11.306336+0000","last_active":"2024-01-24T12:44:12.296559+0000","last_peered":"2024-01-24T12:44:12.296559+0000","last_clean":"2024-01-24T12:44:12.296559+0000","last_became_active":"2024-01-24T12:44:11.306052+0000","last_became_peered":"2024-01-24T12:44:11.306052+0000","last_unstale":"2024-01-24T12:44:12.296559+0000","last_undegraded":"2024-01-24T12:44:12.296559+0000","last_fullsized":"2024-01-24T12:44:12.296559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:59.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310071+0000","last_change":"2024-01-24T12:44:10.959081+0000","last_active":"2024-01-24T12:44:12.310071+0000","last_peered":"2024-01-24T12:44:12.310071+0000","last_clean":"2024-01-24T12:44:12.310071+0000","last_became_active":"2024-01-24T12:44:10.956226+0000","last_became_peered":"2024-01-24T12:44:10.956226+0000","last_unstale":"2024-01-24T12:44:12.310071+0000","last_undegraded":"2024-01-24T12:44:12.310071+0000","last_fullsized":"2024-01-24T12:44:12.310071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:16:37.678733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.297441+0000","last_change":"2024-01-24T12:44:11.335329+0000","last_active":"2024-01-24T12:44:12.297441+0000","last_peered":"2024-01-24T12:44:12.297441+0000","last_clean":"2024-01-24T12:44:12.297441+0000","last_became_active":"2024-01-24T12:44:11.334560+0000","last_became_peered":"2024-01-24T12:44:11.334560+0000","last_unstale":"2024-01-24T12:44:12.297441+0000","last_undegraded":"2024-01-24T12:44:12.297441+0000","last_fullsized":"2024-01-24T12:44:12.297441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:26:31.125275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309208+0000","last_change":"2024-01-24T12:44:11.357364+0000","last_active":"2024-01-24T12:44:12.309208+0000","last_peered":"2024-01-24T12:44:12.309208+0000","last_clean":"2024-01-24T12:44:12.309208+0000","last_became_active":"2024-01-24T12:44:11.354163+0000","last_became_peered":"2024-01-24T12:44:11.354163+0000","last_unstale":"2024-01-24T12:44:12.309208+0000","last_undegraded":"2024-01-24T12:44:12.309208+0000","last_fullsized":"2024-01-24T12:44:12.309208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.309831+0000","last_change":"2024-01-24T12:44:10.954300+0000","last_active":"2024-01-24T12:44:12.309831+0000","last_peered":"2024-01-24T12:44:12.309831+0000","last_clean":"2024-01-24T12:44:12.309831+0000","last_became_active":"2024-01-24T12:44:10.953779+0000","last_became_peered":"2024-01-24T12:44:10.953779+0000","last_unstale":"2024-01-24T12:44:12.309831+0000","last_undegraded":"2024-01-24T12:44:12.309831+0000","last_fullsized":"2024-01-24T12:44:12.309831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:15:58.271375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.308883+0000","last_change":"2024-01-24T12:44:11.343616+0000","last_active":"2024-01-24T12:44:12.308883+0000","last_peered":"2024-01-24T12:44:12.308883+0000","last_clean":"2024-01-24T12:44:12.308883+0000","last_became_active":"2024-01-24T12:44:11.342012+0000","last_became_peered":"2024-01-24T12:44:11.342012+0000","last_unstale":"2024-01-24T12:44:12.308883+0000","last_undegraded":"2024-01-24T12:44:12.308883+0000","last_fullsized":"2024-01-24T12:44:12.308883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:14:17.804326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.310244+0000","last_change":"2024-01-24T12:44:10.956362+0000","last_active":"2024-01-24T12:44:12.310244+0000","last_peered":"2024-01-24T12:44:12.310244+0000","last_clean":"2024-01-24T12:44:12.310244+0000","last_became_active":"2024-01-24T12:44:10.955703+0000","last_became_peered":"2024-01-24T12:44:10.955703+0000","last_unstale":"2024-01-24T12:44:12.310244+0000","last_undegraded":"2024-01-24T12:44:12.310244+0000","last_fullsized":"2024-01-24T12:44:12.310244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:12:23.984897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307009+0000","last_change":"2024-01-24T12:44:11.356491+0000","last_active":"2024-01-24T12:44:12.307009+0000","last_peered":"2024-01-24T12:44:12.307009+0000","last_clean":"2024-01-24T12:44:12.307009+0000","last_became_active":"2024-01-24T12:44:11.356182+0000","last_became_peered":"2024-01-24T12:44:11.356182+0000","last_unstale":"2024-01-24T12:44:12.307009+0000","last_undegraded":"2024-01-24T12:44:12.307009+0000","last_fullsized":"2024-01-24T12:44:12.307009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:57:13.179877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296190+0000","last_change":"2024-01-24T12:44:10.934690+0000","last_active":"2024-01-24T12:44:12.296190+0000","last_peered":"2024-01-24T12:44:12.296190+0000","last_clean":"2024-01-24T12:44:12.296190+0000","last_became_active":"2024-01-24T12:44:10.934221+0000","last_became_peered":"2024-01-24T12:44:10.934221+0000","last_unstale":"2024-01-24T12:44:12.296190+0000","last_undegraded":"2024-01-24T12:44:12.296190+0000","last_fullsized":"2024-01-24T12:44:12.296190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.296123+0000","last_change":"2024-01-24T12:44:11.333832+0000","last_active":"2024-01-24T12:44:12.296123+0000","last_peered":"2024-01-24T12:44:12.296123+0000","last_clean":"2024-01-24T12:44:12.296123+0000","last_became_active":"2024-01-24T12:44:11.333545+0000","last_became_peered":"2024-01-24T12:44:11.333545+0000","last_unstale":"2024-01-24T12:44:12.296123+0000","last_undegraded":"2024-01-24T12:44:12.296123+0000","last_fullsized":"2024-01-24T12:44:12.296123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:10.897652+0000","last_clean_scrub_stamp":"2024-01-24T12:44:10.897652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:14.253999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-24T12:44:12.307335+0000","last_change":"2024-01-24T12:44:10.950192+0000","last_active":"2024-01-24T12:44:12.307335+0000","last_peered":"2024-01-24T12:44:12.307335+0000","last_clean":"2024-01-24T12:44:12.307335+0000","last_became_active":"2024-01-24T12:44:10.949914+0000","last_became_peered":"2024-01-24T12:44:10.949914+0000","last_unstale":"2024-01-24T12:44:12.307335+0000","last_undegraded":"2024-01-24T12:44:12.307335+0000","last_fullsized":"2024-01-24T12:44:12.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:09.886602+0000","last_clean_scrub_stamp":"2024-01-24T12:44:09.886602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:21:49.173785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:23.984 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-24T12:44:23.984 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-24T12:44:23.985 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-24T12:44:23.985 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-24T12:44:24.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 Processor -- start 2024-01-24T12:44:24.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 -- start start 2024-01-24T12:44:24.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 0x7fe27806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2781532f0 0x7fe2781556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780bb370 con 0x7fe27814b540 2024-01-24T12:44:24.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27806ae40 con 0x7fe2781532f0 2024-01-24T12:44:24.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe27d69d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780bc320 con 0x7fe27806a4c0 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2781532f0 0x7fe2781556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe2781532f0 0x7fe2781556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55876/0 (socket says 172.21.15.27:55876) 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 -- 172.21.15.27:0/4226795370 learned_addr learned my addr 172.21.15.27:0/4226795370 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2767fc640 1 --2- 172.21.15.27:0/4226795370 >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 0x7fe27806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 -- 172.21.15.27:0/4226795370 >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 msgr2=0x7fe27806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 --2- 172.21.15.27:0/4226795370 >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 0x7fe27806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 -- 172.21.15.27:0/4226795370 >> v1:172.21.15.124:6789/0 conn(0x7fe27814b540 legacy=0x7fe2780bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2777fe640 1 -- 172.21.15.27:0/4226795370 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780bc590 con 0x7fe2781532f0 2024-01-24T12:44:24.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.143+0000 7fe2767fc640 1 --2- 172.21.15.27:0/4226795370 >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 0x7fe27806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:24.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe2777fe640 1 --2- 172.21.15.27:0/4226795370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2781532f0 0x7fe2781556e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2780c1040 tx=0x7fe27001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2ba951b2475902 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe275ffb640 1 -- 172.21.15.27:0/4226795370 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700a57a0 con 0x7fe2781532f0 2024-01-24T12:44:24.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe275ffb640 1 -- 172.21.15.27:0/4226795370 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2700a5900 con 0x7fe2781532f0 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe275ffb640 1 -- 172.21.15.27:0/4226795370 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700a5c90 con 0x7fe2781532f0 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- 172.21.15.27:0/4226795370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2781532f0 msgr2=0x7fe2781556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- 172.21.15.27:0/4226795370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2781532f0 0x7fe2781556e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2780c1040 tx=0x7fe27001c9d0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- 172.21.15.27:0/4226795370 shutdown_connections 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- 172.21.15.27:0/4226795370 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2781532f0 0x7fe2781556e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- 172.21.15.27:0/4226795370 >> v2:172.21.15.124:3300/0 conn(0x7fe27806a4c0 0x7fe27806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- 172.21.15.27:0/4226795370 >> 172.21.15.27:0/4226795370 conn(0x7fe2780c02e0 msgr2=0x7fe2780c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- 172.21.15.27:0/4226795370 shutdown_connections 2024-01-24T12:44:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- 172.21.15.27:0/4226795370 wait complete. 2024-01-24T12:44:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 Processor -- start 2024-01-24T12:44:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- start start 2024-01-24T12:44:24.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 0x7fe2780a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2781532f0 0x7fe2781e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780a5110 con 0x7fe27814b540 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780a60b0 con 0x7fe27806a4c0 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe27d69d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780a3ab0 con 0x7fe2781532f0 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe2767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe2767fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55880/0 (socket says 172.21.15.27:55880) 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.147+0000 7fe2767fc640 1 -- 172.21.15.27:0/288855271 learned_addr learned my addr 172.21.15.27:0/288855271 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe276ffd640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 0x7fe2780a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2777fe640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2781532f0 0x7fe2781e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 -- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2781532f0 msgr2=0x7fe2781e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2781532f0 0x7fe2781e2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 -- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 msgr2=0x7fe2780a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 0x7fe2780a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 -- 172.21.15.27:0/288855271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270009b30 con 0x7fe27814b540 2024-01-24T12:44:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe276ffd640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 0x7fe2780a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe2767fc640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe26400d800 tx=0x7fe26400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400b6c0 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400b820 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780a3d90 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400bbd0 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2780a4350 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278066400 con 0x7fe27814b540 2024-01-24T12:44:24.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe26400bd30 con 0x7fe27814b540 2024-01-24T12:44:24.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 0x7fe260067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2640836c0 con 0x7fe27814b540 2024-01-24T12:44:24.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe276ffd640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 0x7fe260067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.151+0000 7fe276ffd640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 0x7fe260067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe268000f70 tx=0x7fe268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.155+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe264050ff0 con 0x7fe27814b540 2024-01-24T12:44:24.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2780bfcc0 con 0x7fe27814b540 2024-01-24T12:44:24.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe26f7fe640 1 -- 172.21.15.27:0/288855271 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe2780bfcc0 con 0x7fe27814b540 2024-01-24T12:44:24.344 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:24.344 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 msgr2=0x7fe260067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 0x7fe260067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe268000f70 tx=0x7fe268009040 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 msgr2=0x7fe2780a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe26400d800 tx=0x7fe26400dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 shutdown_connections 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe260065a60 0x7fe260067f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2781532f0 0x7fe2781e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe27814b540 0x7fe2780a3230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 --2- 172.21.15.27:0/288855271 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe27806a4c0 0x7fe2780a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 >> 172.21.15.27:0/288855271 conn(0x7fe2780c02e0 msgr2=0x7fe278149360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 shutdown_connections 2024-01-24T12:44:24.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.343+0000 7fe27d69d640 1 -- 172.21.15.27:0/288855271 wait complete. 2024-01-24T12:44:24.361 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-24T12:44:24.361 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 Processor -- start 2024-01-24T12:44:24.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 -- start start 2024-01-24T12:44:24.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69700bc340 0x7f697006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f69700b6920 0x7f69700b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69700b72b0 con 0x7f69700b7fd0 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697014f150 con 0x7f69700bc340 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f6974fca640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697014f430 con 0x7f69700b6920 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69700bc340 0x7f697006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69700bc340 0x7f697006eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55886/0 (socket says 172.21.15.27:55886) 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 -- 172.21.15.27:0/3284894478 learned_addr learned my addr 172.21.15.27:0/3284894478 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696ed9d640 1 --2- 172.21.15.27:0/3284894478 >> v2:172.21.15.124:3300/0 conn(0x7f69700b6920 0x7f69700b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 -- 172.21.15.27:0/3284894478 >> v2:172.21.15.124:3300/0 conn(0x7f69700b6920 msgr2=0x7f69700b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 --2- 172.21.15.27:0/3284894478 >> v2:172.21.15.124:3300/0 conn(0x7f69700b6920 0x7f69700b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 -- 172.21.15.27:0/3284894478 >> v1:172.21.15.124:6789/0 conn(0x7f69700b7fd0 legacy=0x7f6970148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:24.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.471+0000 7f696e59c640 1 -- 172.21.15.27:0/3284894478 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697014f710 con 0x7f69700bc340 2024-01-24T12:44:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696e59c640 1 --2- 172.21.15.27:0/3284894478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f697006eeb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6970070eb0 tx=0x7f696401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b990a9c2aab32a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696d59a640 1 -- 172.21.15.27:0/3284894478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640ab620 con 0x7f69700bc340 2024-01-24T12:44:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696d59a640 1 -- 172.21.15.27:0/3284894478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640ab780 con 0x7f69700bc340 2024-01-24T12:44:24.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696d59a640 1 -- 172.21.15.27:0/3284894478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640abb10 con 0x7f69700bc340 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/3284894478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 msgr2=0x7f697006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- 172.21.15.27:0/3284894478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f697006eeb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6970070eb0 tx=0x7f696401c400 comp rx=0 tx=0).stop 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/3284894478 shutdown_connections 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- 172.21.15.27:0/3284894478 >> v2:172.21.15.124:3300/0 conn(0x7f69700b6920 0x7f69700b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- 172.21.15.27:0/3284894478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f697006eeb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/3284894478 >> 172.21.15.27:0/3284894478 conn(0x7f6970069ef0 msgr2=0x7f697006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/3284894478 shutdown_connections 2024-01-24T12:44:24.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/3284894478 wait complete. 2024-01-24T12:44:24.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 Processor -- start 2024-01-24T12:44:24.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- start start 2024-01-24T12:44:24.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 0x7f69701367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69700b7fd0 0x7f69700ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69700ba250 con 0x7f69700bc340 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6970136ce0 con 0x7f69700b6920 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69700ba3c0 con 0x7f69700b7fd0 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55900/0 (socket says 172.21.15.27:55900) 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 -- 172.21.15.27:0/2344613320 learned_addr learned my addr 172.21.15.27:0/2344613320 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696e59c640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 0x7f69701367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 -- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69700b7fd0 msgr2=0x7f69700ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696dd9b640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69700b7fd0 0x7f69700ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69700b7fd0 0x7f69700ba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 -- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 msgr2=0x7f69701367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 0x7f69701367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 -- 172.21.15.27:0/2344613320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640094d0 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696e59c640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 0x7f69701367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f696ed9d640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6968007e70 tx=0x7f696800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968014620 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69680147a0 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6970134990 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968014b50 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.475+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6970134f50 con 0x7f69700bc340 2024-01-24T12:44:24.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697004e000 con 0x7f69700bc340 2024-01-24T12:44:24.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6968014cb0 con 0x7f69700bc340 2024-01-24T12:44:24.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f695effd640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 0x7f6950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6968083bb0 con 0x7f69700bc340 2024-01-24T12:44:24.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f696e59c640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 0x7f6950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.479+0000 7f696e59c640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 0x7f6950067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69640af000 tx=0x7f6964008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.483+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f69680514d0 con 0x7f69700bc340 2024-01-24T12:44:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.631+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69700ba500 con 0x7f69700bc340 2024-01-24T12:44:24.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f695effd640 1 -- 172.21.15.27:0/2344613320 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f6968054af0 con 0x7f69700bc340 2024-01-24T12:44:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:24.635 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:24.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 msgr2=0x7f6950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 0x7f6950067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69640af000 tx=0x7f6964008040 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 msgr2=0x7f69700bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6968007e70 tx=0x7f696800e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 shutdown_connections 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6950065a60 0x7f6950067f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69700bc340 0x7f69700bad90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f69700b7fd0 0x7f69700ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 --2- 172.21.15.27:0/2344613320 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f69700b6920 0x7f69701367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 >> 172.21.15.27:0/2344613320 conn(0x7f6970069ef0 msgr2=0x7f6970142190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 shutdown_connections 2024-01-24T12:44:24.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.635+0000 7f6974fca640 1 -- 172.21.15.27:0/2344613320 wait complete. 2024-01-24T12:44:24.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:24.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:24.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 Processor -- start 2024-01-24T12:44:24.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 -- start start 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff3940b8df0 0x7ff394142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff3940b8540 0x7ff394148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff394148a80 con 0x7ff394142d80 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3940b3890 con 0x7ff3940b8540 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39b3a0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3940b3b70 con 0x7ff3940b8df0 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39993d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff394142d80 0x7ff3940b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40638/0 (socket says 172.21.15.27:40638) 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39893b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff3940b8540 0x7ff394148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39993d640 1 -- 172.21.15.27:0/2636557870 learned_addr learned my addr 172.21.15.27:0/2636557870 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39913c640 1 --2- 172.21.15.27:0/2636557870 >> v2:172.21.15.124:3300/0 conn(0x7ff3940b8df0 0x7ff394142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff38bfff640 1 -- 172.21.15.27:0/2636557870 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198152516 0 0) 0x7ff394148a80 con 0x7ff394142d80 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff38bfff640 1 -- 172.21.15.27:0/2636557870 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff380003530 con 0x7ff394142d80 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39893b640 1 -- 172.21.15.27:0/2636557870 >> v2:172.21.15.124:3300/0 conn(0x7ff3940b8df0 msgr2=0x7ff394142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:24.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39893b640 1 --2- 172.21.15.27:0/2636557870 >> v2:172.21.15.124:3300/0 conn(0x7ff3940b8df0 0x7ff394142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39893b640 1 -- 172.21.15.27:0/2636557870 >> v1:172.21.15.27:6789/0 conn(0x7ff394142d80 legacy=0x7ff3940b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.767+0000 7ff39893b640 1 -- 172.21.15.27:0/2636557870 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940b3e50 con 0x7ff3940b8540 2024-01-24T12:44:24.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39893b640 1 --2- 172.21.15.27:0/2636557870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3940b8540 0x7ff394148f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3940b9a80 tx=0x7ff38401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bed37cc7647a2d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff38bfff640 1 -- 172.21.15.27:0/2636557870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394071930 con 0x7ff3940b8540 2024-01-24T12:44:24.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff38bfff640 1 -- 172.21.15.27:0/2636557870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3840ab680 con 0x7ff3940b8540 2024-01-24T12:44:24.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff38bfff640 1 -- 172.21.15.27:0/2636557870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840aba10 con 0x7ff3940b8540 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/2636557870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3940b8540 msgr2=0x7ff394148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/2636557870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3940b8540 0x7ff394148f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3940b9a80 tx=0x7ff38401c460 comp rx=0 tx=0).stop 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/2636557870 shutdown_connections 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/2636557870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3940b8540 0x7ff394148f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/2636557870 >> v2:172.21.15.124:3300/0 conn(0x7ff3940b8df0 0x7ff394142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/2636557870 >> 172.21.15.27:0/2636557870 conn(0x7ff39406a120 msgr2=0x7ff39406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/2636557870 shutdown_connections 2024-01-24T12:44:24.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/2636557870 wait complete. 2024-01-24T12:44:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 Processor -- start 2024-01-24T12:44:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- start start 2024-01-24T12:44:24.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3940b8540 0x7ff394138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 0x7ff39413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394138a70 con 0x7ff394142d80 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39413db70 con 0x7ff3940b8540 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39413d2d0 con 0x7ff3940b8df0 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55916/0 (socket says 172.21.15.27:55916) 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 -- 172.21.15.27:0/1472539484 learned_addr learned my addr 172.21.15.27:0/1472539484 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39913c640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3940b8540 0x7ff394138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39893b640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 0x7ff39413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 -- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 msgr2=0x7ff39413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 0x7ff39413e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 -- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3940b8540 msgr2=0x7ff394138530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3940b8540 0x7ff394138530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 -- 172.21.15.27:0/1472539484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009420 con 0x7ff394142d80 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39893b640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 0x7ff39413e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39993d640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00caa0 tx=0x7ff38c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00ac00 con 0x7ff394142d80 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00ad60 con 0x7ff394142d80 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39413d5b0 con 0x7ff394142d80 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012600 con 0x7ff394142d80 2024-01-24T12:44:24.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.771+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39413e860 con 0x7ff394142d80 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39404e000 con 0x7ff394142d80 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff38c007070 con 0x7ff394142d80 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff389ffb640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 0x7ff37806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff38c082fa0 con 0x7ff394142d80 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff39913c640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 0x7ff37806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.775+0000 7ff39913c640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 0x7ff37806c330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b9d0 tx=0x7ff390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:24.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.779+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff38c050a00 con 0x7ff394142d80 2024-01-24T12:44:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.927+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff394153fa0 con 0x7ff394142d80 2024-01-24T12:44:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff389ffb640 1 -- 172.21.15.27:0/1472539484 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff38c017020 con 0x7ff394142d80 2024-01-24T12:44:24.931 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 msgr2=0x7ff37806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 0x7ff37806c330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff39000b9d0 tx=0x7ff390008040 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 msgr2=0x7ff394149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00caa0 tx=0x7ff38c00cf60 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 shutdown_connections 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff378069e70 0x7ff37806c330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff394142d80 0x7ff394149dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff3940b8df0 0x7ff39413e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 --2- 172.21.15.27:0/1472539484 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff3940b8540 0x7ff394138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 >> 172.21.15.27:0/1472539484 conn(0x7ff39406a120 msgr2=0x7ff3940b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 shutdown_connections 2024-01-24T12:44:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:24.931+0000 7ff39b3a0640 1 -- 172.21.15.27:0/1472539484 wait complete. 2024-01-24T12:44:24.949 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.063+0000 7f4875cbd640 1 Processor -- start 2024-01-24T12:44:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.063+0000 7f4875cbd640 1 -- start start 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f4875cbd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 0x7f48700709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f4875cbd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 0x7f4870144640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f4875cbd640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4870147060 con 0x7f48701474f0 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f4875cbd640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4870144b80 con 0x7f48701441e0 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f4875cbd640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487006ecc0 con 0x7f487006fc30 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486effd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 0x7f4870144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486ffff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f48701474f0 0x7f4870147980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40634/0 (socket says 172.21.15.27:40634) 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486ffff640 1 -- 172.21.15.27:0/687596564 learned_addr learned my addr 172.21.15.27:0/687596564 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486f7fe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 0x7f48700709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486e7fc640 1 -- 172.21.15.27:0/687596564 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817348606 0 0) 0x7f4870147060 con 0x7f48701474f0 2024-01-24T12:44:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486e7fc640 1 -- 172.21.15.27:0/687596564 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4858003530 con 0x7f48701474f0 2024-01-24T12:44:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486f7fe640 1 -- 172.21.15.27:0/687596564 >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 msgr2=0x7f4870144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486f7fe640 1 --2- 172.21.15.27:0/687596564 >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 0x7f4870144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486f7fe640 1 -- 172.21.15.27:0/687596564 >> v1:172.21.15.124:6789/0 conn(0x7f48701474f0 legacy=0x7f4870147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486f7fe640 1 -- 172.21.15.27:0/687596564 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487006ef30 con 0x7f487006fc30 2024-01-24T12:44:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.067+0000 7f486effd640 1 --2- 172.21.15.27:0/687596564 >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 0x7f4870144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- 172.21.15.27:0/687596564 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 0x7f48700709a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48600097c0 tx=0x7f486001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48dbd1d98bee46b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486e7fc640 1 -- 172.21.15.27:0/687596564 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600ab600 con 0x7f487006fc30 2024-01-24T12:44:25.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486e7fc640 1 -- 172.21.15.27:0/687596564 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600a7050 con 0x7f487006fc30 2024-01-24T12:44:25.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486e7fc640 1 -- 172.21.15.27:0/687596564 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600ab980 con 0x7f487006fc30 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/687596564 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 msgr2=0x7f48700709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- 172.21.15.27:0/687596564 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 0x7f48700709a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48600097c0 tx=0x7f486001c480 comp rx=0 tx=0).stop 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/687596564 shutdown_connections 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- 172.21.15.27:0/687596564 >> v2:172.21.15.124:3300/0 conn(0x7f48701441e0 0x7f4870144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- 172.21.15.27:0/687596564 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f487006fc30 0x7f48700709a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/687596564 >> 172.21.15.27:0/687596564 conn(0x7f487006a120 msgr2=0x7f487006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/687596564 shutdown_connections 2024-01-24T12:44:25.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/687596564 wait complete. 2024-01-24T12:44:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 Processor -- start 2024-01-24T12:44:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- start start 2024-01-24T12:44:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 0x7f48701406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48701474f0 0x7f487013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700bc8f0 con 0x7f487006fc30 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870137cd0 con 0x7f48701441e0 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870141020 con 0x7f48701474f0 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55918/0 (socket says 172.21.15.27:55918) 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 -- 172.21.15.27:0/1557708540 learned_addr learned my addr 172.21.15.27:0/1557708540 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486ffff640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48701474f0 0x7f487013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486effd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 0x7f48701406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 -- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48701474f0 msgr2=0x7f487013f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48701474f0 0x7f487013f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 -- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 msgr2=0x7f48701406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 0x7f48701406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 -- 172.21.15.27:0/1557708540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009420 con 0x7f487006fc30 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486effd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 0x7f48701406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f486f7fe640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48600ae040 tx=0x7f486001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600b7450 con 0x7f487006fc30 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600b75d0 con 0x7f487006fc30 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860009420 con 0x7f487006fc30 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600b7980 con 0x7f487006fc30 2024-01-24T12:44:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.071+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700bc2c0 con 0x7f487006fc30 2024-01-24T12:44:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487004e000 con 0x7f487006fc30 2024-01-24T12:44:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f48600b7ae0 con 0x7f487006fc30 2024-01-24T12:44:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f4857fff640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 0x7f485c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f486011d840 con 0x7f487006fc30 2024-01-24T12:44:25.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f486effd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 0x7f485c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.075+0000 7f486effd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 0x7f485c067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4870146d50 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.079+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f48600eb290 con 0x7f487006fc30 2024-01-24T12:44:25.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.227+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f487013dc40 con 0x7f487006fc30 2024-01-24T12:44:25.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4857fff640 1 -- 172.21.15.27:0/1557708540 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48600b00a0 con 0x7f487006fc30 2024-01-24T12:44:25.231 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:25.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 msgr2=0x7f485c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 0x7f485c067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4870146d50 tx=0x7f4864008040 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 msgr2=0x7f487013e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48600ae040 tx=0x7f486001acc0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 shutdown_connections 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f485c065a60 0x7f485c067f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f48701474f0 0x7f487013f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f48701441e0 0x7f48701406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 --2- 172.21.15.27:0/1557708540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f487006fc30 0x7f487013e020 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 >> 172.21.15.27:0/1557708540 conn(0x7f487006a120 msgr2=0x7f48701457f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 shutdown_connections 2024-01-24T12:44:25.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.231+0000 7f4875cbd640 1 -- 172.21.15.27:0/1557708540 wait complete. 2024-01-24T12:44:25.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:25.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 Processor -- start 2024-01-24T12:44:25.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 -- start start 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f954c14a910 0x7f954c144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0b7e30 con 0x7f954c0b8240 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0bbd30 con 0x7f954c0b76c0 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9554178640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0b7b50 con 0x7f954c14a910 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9551f14640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f954c0b8240 0x7f954c0ba140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40654/0 (socket says 172.21.15.27:40654) 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9551f14640 1 -- 172.21.15.27:0/2852457233 learned_addr learned my addr 172.21.15.27:0/2852457233 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:25.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9552715640 1 --2- 172.21.15.27:0/2852457233 >> v2:172.21.15.27:3300/0 conn(0x7f954c14a910 0x7f954c144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9550f12640 1 -- 172.21.15.27:0/2852457233 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226933980 0 0) 0x7f954c0b7e30 con 0x7f954c0b8240 2024-01-24T12:44:25.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9550f12640 1 -- 172.21.15.27:0/2852457233 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9538003530 con 0x7f954c0b8240 2024-01-24T12:44:25.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9552715640 1 -- 172.21.15.27:0/2852457233 >> v1:172.21.15.124:6789/0 conn(0x7f954c0b76c0 legacy=0x7f954c14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9552715640 1 -- 172.21.15.27:0/2852457233 >> v1:172.21.15.27:6789/0 conn(0x7f954c0b8240 legacy=0x7f954c0ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.363+0000 7f9552715640 1 -- 172.21.15.27:0/2852457233 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c14e030 con 0x7f954c14a910 2024-01-24T12:44:25.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9552715640 1 --2- 172.21.15.27:0/2852457233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c14a910 0x7f954c144460 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9544009d90 tx=0x7f954401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968806359e8191ea server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9550f12640 1 -- 172.21.15.27:0/2852457233 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440a5780 con 0x7f954c14a910 2024-01-24T12:44:25.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9550f12640 1 -- 172.21.15.27:0/2852457233 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440a58e0 con 0x7f954c14a910 2024-01-24T12:44:25.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9550f12640 1 -- 172.21.15.27:0/2852457233 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440a5c70 con 0x7f954c14a910 2024-01-24T12:44:25.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/2852457233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c14a910 msgr2=0x7f954c144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 --2- 172.21.15.27:0/2852457233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c14a910 0x7f954c144460 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9544009d90 tx=0x7f954401c8c0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/2852457233 shutdown_connections 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 --2- 172.21.15.27:0/2852457233 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c14a910 0x7f954c144460 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/2852457233 >> 172.21.15.27:0/2852457233 conn(0x7f954c0c0280 msgr2=0x7f954c0c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/2852457233 shutdown_connections 2024-01-24T12:44:25.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/2852457233 wait complete. 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 Processor -- start 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- start start 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 0x7f954c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 0x7f954c0bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c140890 con 0x7f954c0b8240 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c136de0 con 0x7f954c14a910 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0bec80 con 0x7f954c0bf110 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55940/0 (socket says 172.21.15.27:55940) 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 -- 172.21.15.27:0/1071235312 learned_addr learned my addr 172.21.15.27:0/1071235312 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9552715640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 0x7f954c0bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551713640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 0x7f954c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 -- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 msgr2=0x7f954c0bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 0x7f954c0bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 -- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 msgr2=0x7f954c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 0x7f954c13fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 -- 172.21.15.27:0/1071235312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009a70 con 0x7f954c0b8240 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9552715640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 0x7f954c0bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551713640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 0x7f954c13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9551f14640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f954800c4d0 tx=0x7f954800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548005cf0 con 0x7f954c0b8240 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548005e50 con 0x7f954c0b8240 2024-01-24T12:44:25.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c0bfb00 con 0x7f954c0b8240 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548007270 con 0x7f954c0b8240 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.367+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c13f300 con 0x7f954c0b8240 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c04e000 con 0x7f954c0b8240 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95480073d0 con 0x7f954c0b8240 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f95427fc640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 0x7f9530067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95480826e0 con 0x7f954c0b8240 2024-01-24T12:44:25.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f9551713640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 0x7f9530067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.371+0000 7f9551713640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 0x7f9530067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f954c0be590 tx=0x7f953c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.375+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f95480500c0 con 0x7f954c0b8240 2024-01-24T12:44:25.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f954c0bffa0 con 0x7f954c0b8240 2024-01-24T12:44:25.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f95427fc640 1 -- 172.21.15.27:0/1071235312 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9548017020 con 0x7f954c0b8240 2024-01-24T12:44:25.525 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:25.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 msgr2=0x7f9530067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 0x7f9530067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f954c0be590 tx=0x7f953c009040 comp rx=0 tx=0).stop 2024-01-24T12:44:25.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 msgr2=0x7f954c1368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.523+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f954800c4d0 tx=0x7f954800c990 comp rx=0 tx=0).stop 2024-01-24T12:44:25.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 shutdown_connections 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9530065a60 0x7f9530067f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f954c0bf110 0x7f954c0bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f954c14a910 0x7f954c13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 --2- 172.21.15.27:0/1071235312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f954c0b8240 0x7f954c1368a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 >> 172.21.15.27:0/1071235312 conn(0x7f954c0c0280 msgr2=0x7f954c142760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 shutdown_connections 2024-01-24T12:44:25.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.527+0000 7f9554178640 1 -- 172.21.15.27:0/1071235312 wait complete. 2024-01-24T12:44:25.542 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:25.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.651+0000 7f316fa33640 1 Processor -- start 2024-01-24T12:44:25.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.651+0000 7f316fa33640 1 -- start start 2024-01-24T12:44:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f31680b6880 0x7f3168148770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f316806a8f0 0x7f3168142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31680b8220 con 0x7f31680b3e60 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316806a4d0 con 0x7f316806a8f0 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316806ffb0 con 0x7f31680b6880 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f316806a8f0 0x7f3168142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316cfce640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f31680b3e60 0x7f31680b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40664/0 (socket says 172.21.15.27:40664) 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316cfce640 1 -- 172.21.15.27:0/1359033624 learned_addr learned my addr 172.21.15.27:0/1359033624 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316d7cf640 1 --2- 172.21.15.27:0/1359033624 >> v2:172.21.15.124:3300/0 conn(0x7f31680b6880 0x7f3168148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 -- 172.21.15.27:0/1359033624 >> v2:172.21.15.124:3300/0 conn(0x7f31680b6880 msgr2=0x7f3168148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 --2- 172.21.15.27:0/1359033624 >> v2:172.21.15.124:3300/0 conn(0x7f31680b6880 0x7f3168148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 -- 172.21.15.27:0/1359033624 >> v1:172.21.15.27:6789/0 conn(0x7f31680b3e60 legacy=0x7f31680b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 -- 172.21.15.27:0/1359033624 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168069e50 con 0x7f316806a8f0 2024-01-24T12:44:25.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f315ffff640 1 -- 172.21.15.27:0/1359033624 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489541613 0 0) 0x7f31680b8220 con 0x7f31680b3e60 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316dfd0640 1 --2- 172.21.15.27:0/1359033624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f316806a8f0 0x7f3168142680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31680b9f30 tx=0x7f316001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13404b2c770dd5c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f315ffff640 1 -- 172.21.15.27:0/1359033624 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600a5940 con 0x7f316806a8f0 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f315ffff640 1 -- 172.21.15.27:0/1359033624 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600a5aa0 con 0x7f316806a8f0 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f315ffff640 1 -- 172.21.15.27:0/1359033624 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600a5e30 con 0x7f316806a8f0 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 -- 172.21.15.27:0/1359033624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f316806a8f0 msgr2=0x7f3168142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.655+0000 7f316fa33640 1 --2- 172.21.15.27:0/1359033624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f316806a8f0 0x7f3168142680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31680b9f30 tx=0x7f316001c880 comp rx=0 tx=0).stop 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/1359033624 shutdown_connections 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 --2- 172.21.15.27:0/1359033624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f316806a8f0 0x7f3168142680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 --2- 172.21.15.27:0/1359033624 >> v2:172.21.15.124:3300/0 conn(0x7f31680b6880 0x7f3168148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/1359033624 >> 172.21.15.27:0/1359033624 conn(0x7f316806ae30 msgr2=0x7f316806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/1359033624 shutdown_connections 2024-01-24T12:44:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/1359033624 wait complete. 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 Processor -- start 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- start start 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f316806a8f0 0x7f316813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f31680b3e60 0x7f3168147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3168143dc0 con 0x7f31680b6880 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316813f8d0 con 0x7f316806a8f0 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3168152f00 con 0x7f31680b3e60 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55962/0 (socket says 172.21.15.27:55962) 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 -- 172.21.15.27:0/895973469 learned_addr learned my addr 172.21.15.27:0/895973469 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316cfce640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f31680b3e60 0x7f3168147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316d7cf640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f316806a8f0 0x7f316813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 -- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f31680b3e60 msgr2=0x7f3168147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f31680b3e60 0x7f3168147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 -- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f316806a8f0 msgr2=0x7f316813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f316806a8f0 0x7f316813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 -- 172.21.15.27:0/895973469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009a70 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316dfd0640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3160098460 tx=0x7f3160019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600b7610 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600b7770 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3168152cb0 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600b7b20 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3168143700 con 0x7f31680b6880 2024-01-24T12:44:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3168143f00 con 0x7f31680b6880 2024-01-24T12:44:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.659+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31600b4050 con 0x7f31680b6880 2024-01-24T12:44:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.663+0000 7f315dffb640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.663+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f316011ded0 con 0x7f31680b6880 2024-01-24T12:44:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.663+0000 7f316d7cf640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.663+0000 7f316d7cf640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 0x7f314c067f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f315800b9d0 tx=0x7f3158008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.667+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3168143f00 con 0x7f31680b6880 2024-01-24T12:44:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.847+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3168143f00 con 0x7f31680b6880 2024-01-24T12:44:25.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.847+0000 7f315dffb640 1 -- 172.21.15.27:0/895973469 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f3168143f00 con 0x7f31680b6880 2024-01-24T12:44:25.850 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:25.850 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:25.851 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:25.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 msgr2=0x7f314c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 0x7f314c067f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f315800b9d0 tx=0x7f3158008040 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 msgr2=0x7f31681e3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3160098460 tx=0x7f3160019620 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 shutdown_connections 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f314c065a60 0x7f314c067f20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31680b6880 0x7f31681e3e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f31680b3e60 0x7f3168147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 --2- 172.21.15.27:0/895973469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f316806a8f0 0x7f316813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 >> 172.21.15.27:0/895973469 conn(0x7f316806ae30 msgr2=0x7f31680bc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 shutdown_connections 2024-01-24T12:44:25.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.851+0000 7f316fa33640 1 -- 172.21.15.27:0/895973469 wait complete. 2024-01-24T12:44:25.868 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:25.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.987+0000 7fdc4cf90640 1 Processor -- start 2024-01-24T12:44:25.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.987+0000 7fdc4cf90640 1 -- start start 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4cf90640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc4806a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4cf90640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdc480b81c0 0x7fdc480b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4cf90640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc480702c0 con 0x7fdc4814a9e0 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4cf90640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480b8650 con 0x7fdc480b81c0 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4cf90640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4806ff50 con 0x7fdc48069d20 2024-01-24T12:44:25.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc46d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdc4814a9e0 0x7fdc4814dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40672/0 (socket says 172.21.15.27:40672) 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc46d9d640 1 -- 172.21.15.27:0/2227686227 learned_addr learned my addr 172.21.15.27:0/2227686227 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4659c640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc4806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928181422 0 0) 0x7fdc480702c0 con 0x7fdc4814a9e0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/2227686227 >> v2:172.21.15.124:3300/0 conn(0x7fdc480b81c0 0x7fdc480b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc30003530 con 0x7fdc4814a9e0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250186730 0 0) 0x7fdc30003530 con 0x7fdc4814a9e0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 msgr2=0x7fdc4806a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc4806a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 >> v2:172.21.15.124:3300/0 conn(0x7fdc480b81c0 msgr2=0x7fdc480b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 --2- 172.21.15.27:0/2227686227 >> v2:172.21.15.124:3300/0 conn(0x7fdc480b81c0 0x7fdc480b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48145050 con 0x7fdc4814a9e0 2024-01-24T12:44:25.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fdc40001a00 con 0x7fdc4814a9e0 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 >> v1:172.21.15.27:6789/0 conn(0x7fdc4814a9e0 legacy=0x7fdc4814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc30003980 0x7fdc30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc300047d0 0x7fdc30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480b8650 con 0x7fdc300047d0 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4806ff50 con 0x7fdc30003980 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3000b9c0 con 0x7fdc48069d20 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc300047d0 0x7fdc30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4659c640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc30003980 0x7fdc30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc46d9d640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 -- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 msgr2=0x7fdc30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 -- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc30003980 msgr2=0x7fdc30003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:25.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc30003980 0x7fdc30003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:25.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 -- 172.21.15.27:0/2227686227 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30003530 con 0x7fdc300047d0 2024-01-24T12:44:25.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4659c640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc30003980 0x7fdc30003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:25.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc46d9d640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc48069d20 0x7fdc30005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:25.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc300047d0 0x7fdc30004c50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009ae0 tx=0x7fdc3c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4490388a1ea042d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:25.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0a55a0 con 0x7fdc300047d0 2024-01-24T12:44:25.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0a5700 con 0x7fdc300047d0 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.991+0000 7fdc4559a640 1 -- 172.21.15.27:0/2227686227 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0a5ab0 con 0x7fdc300047d0 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/2227686227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc300047d0 msgr2=0x7fdc30004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/2227686227 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc300047d0 0x7fdc30004c50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009ae0 tx=0x7fdc3c01ca90 comp rx=0 tx=0).stop 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc46d9d640 1 -- 172.21.15.27:0/2227686227 reap_dead start 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/2227686227 shutdown_connections 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/2227686227 >> 172.21.15.27:0/2227686227 conn(0x7fdc4806ae30 msgr2=0x7fdc4806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/2227686227 shutdown_connections 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/2227686227 wait complete. 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 Processor -- start 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- start start 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc300047d0 0x7fdc480b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc481434e0 0x7fdc481e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480b6470 con 0x7fdc480b6930 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48149fd0 con 0x7fdc300047d0 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48136e50 con 0x7fdc481434e0 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55980/0 (socket says 172.21.15.27:55980) 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 -- 172.21.15.27:0/3748904528 learned_addr learned my addr 172.21.15.27:0/3748904528 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 -- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc481434e0 msgr2=0x7fdc481e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc481434e0 0x7fdc481e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4659c640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc300047d0 0x7fdc480b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 -- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc300047d0 msgr2=0x7fdc480b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc300047d0 0x7fdc480b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 -- 172.21.15.27:0/3748904528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48143050 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc45d9b640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b0040 tx=0x7fdc30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c004220 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c004380 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4814a610 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ad890 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480b6e60 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.995+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc481431e0 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.999+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc3c0b4040 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.999+0000 7fdc36ffd640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 0x7fdc28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.999+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc3c11d870 con 0x7fdc480b6930 2024-01-24T12:44:26.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.999+0000 7fdc4659c640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 0x7fdc28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:25.999+0000 7fdc4659c640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 0x7fdc28067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009910 tx=0x7fdc38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.003+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdc3c0eb490 con 0x7fdc480b6930 2024-01-24T12:44:26.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.159+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc4804e000 con 0x7fdc480b6930 2024-01-24T12:44:26.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.163+0000 7fdc36ffd640 1 -- 172.21.15.27:0/3748904528 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fdc3c0eeab0 con 0x7fdc480b6930 2024-01-24T12:44:26.165 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:26.166 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:26.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 msgr2=0x7fdc28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 0x7fdc28067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009910 tx=0x7fdc38008040 comp rx=0 tx=0).stop 2024-01-24T12:44:26.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 msgr2=0x7fdc48149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b0040 tx=0x7fdc30005800 comp rx=0 tx=0).stop 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 shutdown_connections 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdc28065a60 0x7fdc28067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdc481434e0 0x7fdc481e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc480b6930 0x7fdc48149a90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 --2- 172.21.15.27:0/3748904528 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdc300047d0 0x7fdc480b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 >> 172.21.15.27:0/3748904528 conn(0x7fdc4806ae30 msgr2=0x7fdc480ba2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 shutdown_connections 2024-01-24T12:44:26.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.167+0000 7fdc4cf90640 1 -- 172.21.15.27:0/3748904528 wait complete. 2024-01-24T12:44:26.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:26.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.307+0000 7f1e665d3640 1 Processor -- start 2024-01-24T12:44:26.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.307+0000 7f1e665d3640 1 -- start start 2024-01-24T12:44:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e665d3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1e600b8540 0x7f1e60148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e665d3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e60148a80 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e665d3640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600b3890 con 0x7f1e600b8df0 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e665d3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600b3b70 con 0x7f1e600b8540 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e64b70640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1e600b3320 0x7f1e601531b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40688/0 (socket says 172.21.15.27:40688) 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e64b70640 1 -- 172.21.15.27:0/3397585017 learned_addr learned my addr 172.21.15.27:0/3397585017 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5f7fe640 1 --2- 172.21.15.27:0/3397585017 >> v2:172.21.15.124:3300/0 conn(0x7f1e600b8540 0x7f1e60148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859825869 0 0) 0x7f1e60148a80 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e48003530 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311747456 0 0) 0x7f1e48003530 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 >> v2:172.21.15.124:3300/0 conn(0x7f1e600b8540 msgr2=0x7f1e60148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 --2- 172.21.15.27:0/3397585017 >> v2:172.21.15.124:3300/0 conn(0x7f1e600b8540 0x7f1e60148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 >> v1:172.21.15.124:6789/0 conn(0x7f1e600b8df0 legacy=0x7f1e60142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600b3e50 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f1e58001a00 con 0x7f1e600b3320 2024-01-24T12:44:26.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 >> v1:172.21.15.27:6789/0 conn(0x7f1e600b3320 legacy=0x7f1e601531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 0x7f1e48003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480047d0 0x7f1e48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e48005190 0x7f1e4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600b3b70 con 0x7f1e480039d0 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800c090 con 0x7f1e48005190 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4800c250 con 0x7f1e480047d0 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 0x7f1e48003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e64b70640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e48005190 0x7f1e4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5f7fe640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480047d0 0x7f1e48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 -- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480047d0 msgr2=0x7f1e48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480047d0 0x7f1e48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 -- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e48005190 msgr2=0x7f1e4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e48005190 0x7f1e4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e64b70640 1 -- 172.21.15.27:0/3397585017 reap_dead start 2024-01-24T12:44:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 -- 172.21.15.27:0/3397585017 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48003530 con 0x7f1e480039d0 2024-01-24T12:44:26.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 0x7f1e48003df0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001780 tx=0x7f1e5001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e9b226d3bb46c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60071930 con 0x7f1e480039d0 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.311+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500a7050 con 0x7f1e480039d0 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5effd640 1 -- 172.21.15.27:0/3397585017 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50003600 con 0x7f1e480039d0 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 msgr2=0x7f1e48003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 0x7f1e48003df0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001780 tx=0x7f1e5001c3e0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/3397585017 shutdown_connections 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 --2- 172.21.15.27:0/3397585017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e480039d0 0x7f1e48003df0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/3397585017 >> 172.21.15.27:0/3397585017 conn(0x7f1e6006a120 msgr2=0x7f1e6006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/3397585017 shutdown_connections 2024-01-24T12:44:26.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/3397585017 wait complete. 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 Processor -- start 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- start start 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480039d0 0x7f1e600bb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 0x7f1e6006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600b9fa0 con 0x7f1e600bb960 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600bacf0 con 0x7f1e6006f170 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6013dae0 con 0x7f1e480039d0 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55996/0 (socket says 172.21.15.27:55996) 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 -- 172.21.15.27:0/1397361898 learned_addr learned my addr 172.21.15.27:0/1397361898 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480039d0 0x7f1e600bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e64b70640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 0x7f1e6006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 -- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480039d0 msgr2=0x7f1e600bb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480039d0 0x7f1e600bb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 -- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 msgr2=0x7f1e6006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 0x7f1e6006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 -- 172.21.15.27:0/1397361898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60143380 con 0x7f1e600bb960 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e64b70640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 0x7f1e6006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5f7fe640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e54011500 tx=0x7f1e540119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54015870 con 0x7f1e600bb960 2024-01-24T12:44:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540159d0 con 0x7f1e600bb960 2024-01-24T12:44:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54015d40 con 0x7f1e600bb960 2024-01-24T12:44:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e600bbfb0 con 0x7f1e600bb960 2024-01-24T12:44:26.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.315+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e601437a0 con 0x7f1e600bb960 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600ba110 con 0x7f1e600bb960 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e54013400 con 0x7f1e600bb960 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e5cff9640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e54083510 con 0x7f1e600bb960 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.319+0000 7f1e5ffff640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 0x7f1e4c067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001750 tx=0x7f1e500011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.323+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1e600ba110 con 0x7f1e600bb960 2024-01-24T12:44:26.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.483+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e600bbde0 con 0x7f1e600bb960 2024-01-24T12:44:26.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.483+0000 7f1e5cff9640 1 -- 172.21.15.27:0/1397361898 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e54050ee0 con 0x7f1e600bb960 2024-01-24T12:44:26.487 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:26.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 msgr2=0x7f1e4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 0x7f1e4c067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e50001750 tx=0x7f1e500011a0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 msgr2=0x7f1e6006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e54011500 tx=0x7f1e540119c0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 shutdown_connections 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1e6006f170 0x7f1e6006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e600bb960 0x7f1e6006ec30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 --2- 172.21.15.27:0/1397361898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1e480039d0 0x7f1e600bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 >> 172.21.15.27:0/1397361898 conn(0x7f1e6006a120 msgr2=0x7f1e6006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 shutdown_connections 2024-01-24T12:44:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.487+0000 7f1e665d3640 1 -- 172.21.15.27:0/1397361898 wait complete. 2024-01-24T12:44:26.506 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 Processor -- start 2024-01-24T12:44:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 -- start start 2024-01-24T12:44:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9400b8530 0x7fd940153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94006ec30 con 0x7fd9400b8df0 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd940071890 con 0x7fd940070e40 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd94721d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400b30e0 con 0x7fd9400b8530 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd9457ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9400b8530 0x7fd940153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd944fb9640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd9400b8df0 0x7fd940147eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40702/0 (socket says 172.21.15.27:40702) 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd9457ba640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9400b8530 0x7fd940153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56002/0 (socket says 172.21.15.27:56002) 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd944fb9640 1 -- 172.21.15.27:0/861133088 learned_addr learned my addr 172.21.15.27:0/861133088 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd9457ba640 1 -- 172.21.15.27:0/861133088 >> v1:172.21.15.124:6789/0 conn(0x7fd940070e40 legacy=0x7fd940141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd9457ba640 1 -- 172.21.15.27:0/861133088 >> v1:172.21.15.27:6789/0 conn(0x7fd9400b8df0 legacy=0x7fd940147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd9457ba640 1 -- 172.21.15.27:0/861133088 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400712d0 con 0x7fd9400b8530 2024-01-24T12:44:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.631+0000 7fd93f7fe640 1 -- 172.21.15.27:0/861133088 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603490839 0 0) 0x7fd94006ec30 con 0x7fd9400b8df0 2024-01-24T12:44:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd9457ba640 1 --2- 172.21.15.27:0/861133088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940153010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd938009d90 tx=0x7fd93801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74b5319c750443 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93f7fe640 1 -- 172.21.15.27:0/861133088 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380a58c0 con 0x7fd9400b8530 2024-01-24T12:44:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93f7fe640 1 -- 172.21.15.27:0/861133088 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9380a5a20 con 0x7fd9400b8530 2024-01-24T12:44:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93f7fe640 1 -- 172.21.15.27:0/861133088 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380a5db0 con 0x7fd9400b8530 2024-01-24T12:44:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/861133088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 msgr2=0x7fd940153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 --2- 172.21.15.27:0/861133088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940153010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd938009d90 tx=0x7fd93801c910 comp rx=0 tx=0).stop 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/861133088 shutdown_connections 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 --2- 172.21.15.27:0/861133088 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940153010 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/861133088 >> 172.21.15.27:0/861133088 conn(0x7fd94006a120 msgr2=0x7fd94006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/861133088 shutdown_connections 2024-01-24T12:44:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/861133088 wait complete. 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 Processor -- start 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- start start 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 0x7fd940146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9401466b0 0x7fd9401e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940145d70 con 0x7fd9400b8530 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940134e50 con 0x7fd9401466b0 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94013ac00 con 0x7fd9400b8df0 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56016/0 (socket says 172.21.15.27:56016) 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 -- 172.21.15.27:0/1787929153 learned_addr learned my addr 172.21.15.27:0/1787929153 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93ffff640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 0x7fd940146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd9457ba640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9401466b0 0x7fd9401e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 -- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 msgr2=0x7fd940146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 0x7fd940146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 -- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9401466b0 msgr2=0x7fd9401e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9401466b0 0x7fd9401e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 -- 172.21.15.27:0/1787929153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938009a70 con 0x7fd9400b8530 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93ffff640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 0x7fd940146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd944fb9640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd93400c480 tx=0x7fd93400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340074e0 con 0x7fd9400b8530 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd934007660 con 0x7fd9400b8530 2024-01-24T12:44:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd940139bd0 con 0x7fd9400b8530 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934004a30 con 0x7fd9400b8530 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.635+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94006f160 con 0x7fd9400b8530 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94004e000 con 0x7fd9400b8530 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd934004b90 con 0x7fd9400b8530 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd93d7fa640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 0x7fd924067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9340822e0 con 0x7fd9400b8530 2024-01-24T12:44:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd93ffff640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 0x7fd924067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.639+0000 7fd93ffff640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 0x7fd924067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd940148200 tx=0x7fd92c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.643+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd934053730 con 0x7fd9400b8530 2024-01-24T12:44:26.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.799+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd94013a950 con 0x7fd9400b8530 2024-01-24T12:44:26.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.799+0000 7fd93d7fa640 1 -- 172.21.15.27:0/1787929153 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9340532c0 con 0x7fd9400b8530 2024-01-24T12:44:26.802 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 msgr2=0x7fd924067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 0x7fd924067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd940148200 tx=0x7fd92c009040 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 msgr2=0x7fd940145830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd93400c480 tx=0x7fd93400c940 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 shutdown_connections 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd924065a60 0x7fd924067f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd9401466b0 0x7fd9401e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd9400b8df0 0x7fd940146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 --2- 172.21.15.27:0/1787929153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9400b8530 0x7fd940145830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 >> 172.21.15.27:0/1787929153 conn(0x7fd94006a120 msgr2=0x7fd9400b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 shutdown_connections 2024-01-24T12:44:26.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.803+0000 7fd94721d640 1 -- 172.21.15.27:0/1787929153 wait complete. 2024-01-24T12:44:26.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:26.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 Processor -- start 2024-01-24T12:44:26.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 -- start start 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b8540 0x7fdde0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdde00b3320 0x7fdde0149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde0148a80 con 0x7fdde00b8df0 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00b3890 con 0x7fdde00b3320 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdde55d7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00b3b70 con 0x7fdde00b8540 2024-01-24T12:44:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdde00b3320 0x7fdde0149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdde00b3320 0x7fdde0149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56020/0 (socket says 172.21.15.27:56020) 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1237548826 learned_addr learned my addr 172.21.15.27:0/1237548826 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fddde7fc640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b8540 0x7fdde0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1237548826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b8540 msgr2=0x7fdde0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b8540 0x7fdde0148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1237548826 >> v1:172.21.15.124:6789/0 conn(0x7fdde00b8df0 legacy=0x7fdde0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.951+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1237548826 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00b3e50 con 0x7fdde00b3320 2024-01-24T12:44:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b3320 0x7fdde0149450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009e50 tx=0x7fddd801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b939defc27e37c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddddffb640 1 -- 172.21.15.27:0/1237548826 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80a5880 con 0x7fdde00b3320 2024-01-24T12:44:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddddffb640 1 -- 172.21.15.27:0/1237548826 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd80a59e0 con 0x7fdde00b3320 2024-01-24T12:44:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddddffb640 1 -- 172.21.15.27:0/1237548826 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80a5d70 con 0x7fdde00b3320 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1237548826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b3320 msgr2=0x7fdde0149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b3320 0x7fdde0149450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009e50 tx=0x7fddd801ca10 comp rx=0 tx=0).stop 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1237548826 shutdown_connections 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b3320 0x7fdde0149450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1237548826 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b8540 0x7fdde0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1237548826 >> 172.21.15.27:0/1237548826 conn(0x7fdde006a120 msgr2=0x7fdde006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1237548826 shutdown_connections 2024-01-24T12:44:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1237548826 wait complete. 2024-01-24T12:44:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 Processor -- start 2024-01-24T12:44:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- start start 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b3320 0x7fdde0139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdde00b8540 0x7fdde01e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde013a3c0 con 0x7fdde00b8df0 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde01e3d50 con 0x7fdde00b8540 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde01e4030 con 0x7fdde00b3320 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56022/0 (socket says 172.21.15.27:56022) 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1571854899 learned_addr learned my addr 172.21.15.27:0/1571854899 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b3320 msgr2=0x7fdde0139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b3320 0x7fdde0139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdde00b8540 msgr2=0x7fdde01e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdde00b8540 0x7fdde01e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 -- 172.21.15.27:0/1571854899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009b30 con 0x7fdde00b8df0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdddf7fe640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddd801a640 tx=0x7fddd80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80b8670 con 0x7fdde00b8df0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd80b87d0 con 0x7fdde00b8df0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde013ed30 con 0x7fdde00b8df0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.955+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80b8b80 con 0x7fdde00b8df0 2024-01-24T12:44:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde014aa70 con 0x7fdde00b8df0 2024-01-24T12:44:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde004e000 con 0x7fdde00b8df0 2024-01-24T12:44:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fddd80b8ce0 con 0x7fdde00b8df0 2024-01-24T12:44:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fddc77fe640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 0x7fddcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd811e7a0 con 0x7fdde00b8df0 2024-01-24T12:44:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fdddeffd640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 0x7fddcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.959+0000 7fdddeffd640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 0x7fddcc067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fddd0000f70 tx=0x7fddd00079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:26.963+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fddd80ec3d0 con 0x7fdde00b8df0 2024-01-24T12:44:27.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.119+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdde0147940 con 0x7fdde00b8df0 2024-01-24T12:44:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.119+0000 7fddc77fe640 1 -- 172.21.15.27:0/1571854899 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddd80ef9f0 con 0x7fdde00b8df0 2024-01-24T12:44:27.121 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 msgr2=0x7fddcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 0x7fddcc067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fddd0000f70 tx=0x7fddd00079c0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 msgr2=0x7fdde0132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddd801a640 tx=0x7fddd80197b0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 shutdown_connections 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fddcc065a60 0x7fddcc067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdde00b8df0 0x7fdde0132610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdde00b8540 0x7fdde01e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 --2- 172.21.15.27:0/1571854899 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdde00b3320 0x7fdde0139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 >> 172.21.15.27:0/1571854899 conn(0x7fdde006a120 msgr2=0x7fdde00b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 shutdown_connections 2024-01-24T12:44:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.123+0000 7fdde55d7640 1 -- 172.21.15.27:0/1571854899 wait complete. 2024-01-24T12:44:27.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.255+0000 7fd6ac01f640 1 Processor -- start 2024-01-24T12:44:27.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.255+0000 7fd6ac01f640 1 -- start start 2024-01-24T12:44:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6ac01f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 0x7fd6a4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6ac01f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6ac01f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a4071770 con 0x7fd6a4142d50 2024-01-24T12:44:27.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6ac01f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40b37e0 con 0x7fd6a40bc340 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6ac01f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a40b3ac0 con 0x7fd6a4149470 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6a9dbb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 0x7fd6a4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:54184/0 (socket says 172.21.15.27:54184) 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 -- 172.21.15.27:0/3227104786 learned_addr learned my addr 172.21.15.27:0/3227104786 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:27.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6a95ba640 1 --1- 172.21.15.27:0/3227104786 >> v1:172.21.15.124:6789/0 conn(0x7fd6a4142d50 0x7fd6a4148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:40688/0 (socket says 172.21.15.27:40688) 2024-01-24T12:44:27.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 -- 172.21.15.27:0/3227104786 >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 msgr2=0x7fd6a4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 --2- 172.21.15.27:0/3227104786 >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 0x7fd6a4142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 -- 172.21.15.27:0/3227104786 >> v1:172.21.15.124:6789/0 conn(0x7fd6a4142d50 legacy=0x7fd6a4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 -- 172.21.15.27:0/3227104786 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a40b3da0 con 0x7fd6a4149470 2024-01-24T12:44:27.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6a9dbb640 1 --2- 172.21.15.27:0/3227104786 >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 0x7fd6a4142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:44:27.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.259+0000 7fd6aa5bc640 1 --2- 172.21.15.27:0/3227104786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd694009870 tx=0x7fd69401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11357250d2f2d1b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a8db9640 1 -- 172.21.15.27:0/3227104786 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940a8a30 con 0x7fd6a4149470 2024-01-24T12:44:27.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a8db9640 1 -- 172.21.15.27:0/3227104786 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6940a8b90 con 0x7fd6a4149470 2024-01-24T12:44:27.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a8db9640 1 -- 172.21.15.27:0/3227104786 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940b0440 con 0x7fd6a4149470 2024-01-24T12:44:27.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/3227104786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 msgr2=0x7fd6a4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/3227104786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd694009870 tx=0x7fd69401ed30 comp rx=0 tx=0).stop 2024-01-24T12:44:27.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/3227104786 shutdown_connections 2024-01-24T12:44:27.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/3227104786 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a4149470 0x7fd6a4153110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/3227104786 >> v2:172.21.15.124:3300/0 conn(0x7fd6a40bc340 0x7fd6a4142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/3227104786 >> 172.21.15.27:0/3227104786 conn(0x7fd6a4069ef0 msgr2=0x7fd6a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/3227104786 shutdown_connections 2024-01-24T12:44:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/3227104786 wait complete. 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 Processor -- start 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- start start 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a40bc340 0x7fd6a41cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6a41cf450 0x7fd6a41de930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41451f0 con 0x7fd6a4149470 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41ddf10 con 0x7fd6a41cf450 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4145490 con 0x7fd6a40bc340 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56030/0 (socket says 172.21.15.27:56030) 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 -- 172.21.15.27:0/2777612254 learned_addr learned my addr 172.21.15.27:0/2777612254 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:27.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a9dbb640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a40bc340 0x7fd6a41cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6aa5bc640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6a41cf450 0x7fd6a41de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 -- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a40bc340 msgr2=0x7fd6a41cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a40bc340 0x7fd6a41cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 -- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6a41cf450 msgr2=0x7fd6a41de930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6a41cf450 0x7fd6a41de930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 -- 172.21.15.27:0/2777612254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c009a70 con 0x7fd6a4149470 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a95ba640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c490 tx=0x7fd69800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698007480 con 0x7fd6a4149470 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6980075e0 con 0x7fd6a4149470 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940094d0 con 0x7fd6a4149470 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698004a10 con 0x7fd6a4149470 2024-01-24T12:44:27.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.263+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a40b5950 con 0x7fd6a4149470 2024-01-24T12:44:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a404e000 con 0x7fd6a4149470 2024-01-24T12:44:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd698004b70 con 0x7fd6a4149470 2024-01-24T12:44:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6a27fc640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 0x7fd690067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd698082550 con 0x7fd6a4149470 2024-01-24T12:44:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6a9dbb640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 0x7fd690067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.267+0000 7fd6a9dbb640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 0x7fd690067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd69c007600 tx=0x7fd69c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.271+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd69804ffa0 con 0x7fd6a4149470 2024-01-24T12:44:27.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.459+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6a40b4cb0 con 0x7fd6a4149470 2024-01-24T12:44:27.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.459+0000 7fd6a27fc640 1 -- 172.21.15.27:0/2777612254 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7fd6980535c0 con 0x7fd6a4149470 2024-01-24T12:44:27.461 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:27.461 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:27.461 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 msgr2=0x7fd690067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 0x7fd690067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd69c007600 tx=0x7fd69c00b040 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 msgr2=0x7fd6a41de3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c490 tx=0x7fd69800c950 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 shutdown_connections 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd690065a60 0x7fd690067f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd6a41cf450 0x7fd6a41de930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd6a4149470 0x7fd6a41de3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 --2- 172.21.15.27:0/2777612254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd6a40bc340 0x7fd6a41cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 >> 172.21.15.27:0/2777612254 conn(0x7fd6a4069ef0 msgr2=0x7fd6a40b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 shutdown_connections 2024-01-24T12:44:27.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.463+0000 7fd6ac01f640 1 -- 172.21.15.27:0/2777612254 wait complete. 2024-01-24T12:44:27.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.599+0000 7f0c72a24640 1 Processor -- start 2024-01-24T12:44:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.599+0000 7f0c72a24640 1 -- start start 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 0x7f0c6c0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c6c06a4c0 0x7f0c6c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c14dfd0 0x7f0c6c14e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c06ae40 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c0bc320 con 0x7f0c6c14b540 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c72a24640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0bb650 con 0x7f0c6c14dfd0 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c6c06a4c0 0x7f0c6c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0c6c06a4c0 0x7f0c6c06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56044/0 (socket says 172.21.15.27:56044) 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1211980444 learned_addr learned my addr 172.21.15.27:0/1211980444 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c70fc1640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c14dfd0 0x7f0c6c14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6bfff640 1 --2- 172.21.15.27:0/1211980444 >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 0x7f0c6c0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1211980444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c14dfd0 msgr2=0x7f0c6c14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c14dfd0 0x7f0c6c14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1211980444 >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 msgr2=0x7f0c6c0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1211980444 >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 0x7f0c6c0bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1211980444 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0bc590 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.603+0000 7f0c6bfff640 1 --2- 172.21.15.27:0/1211980444 >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 0x7f0c6c0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:27.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c06a4c0 0x7f0c6c06a900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0be590 tx=0x7f0c6001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5215be955ad0f283 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6affd640 1 -- 172.21.15.27:0/1211980444 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600a89b0 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6affd640 1 -- 172.21.15.27:0/1211980444 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600a8b10 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6affd640 1 -- 172.21.15.27:0/1211980444 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600a8ea0 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- 172.21.15.27:0/1211980444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c06a4c0 msgr2=0x7f0c6c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c06a4c0 0x7f0c6c06a900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0be590 tx=0x7f0c6001ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- 172.21.15.27:0/1211980444 shutdown_connections 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c14dfd0 0x7f0c6c14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1211980444 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c06a4c0 0x7f0c6c06a900 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1211980444 >> v2:172.21.15.124:3300/0 conn(0x7f0c6c14b540 0x7f0c6c0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- 172.21.15.27:0/1211980444 >> 172.21.15.27:0/1211980444 conn(0x7f0c6c0c02e0 msgr2=0x7f0c6c0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- 172.21.15.27:0/1211980444 shutdown_connections 2024-01-24T12:44:27.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- 172.21.15.27:0/1211980444 wait complete. 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 Processor -- start 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- start start 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c06a4c0 0x7f0c6c1d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c6c14dfd0 0x7f0c6c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c1d5200 con 0x7f0c6c14b540 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0a5e60 con 0x7f0c6c14dfd0 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c72a24640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0b9720 con 0x7f0c6c06a4c0 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56054/0 (socket says 172.21.15.27:56054) 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1178151609 learned_addr learned my addr 172.21.15.27:0/1178151609 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c06a4c0 msgr2=0x7f0c6c1d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6bfff640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c06a4c0 0x7f0c6c1d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c06a4c0 0x7f0c6c1d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c70fc1640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c6c14dfd0 0x7f0c6c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c6c14dfd0 msgr2=0x7f0c6c0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c6c14dfd0 0x7f0c6c0b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 -- 172.21.15.27:0/1178151609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600094d0 con 0x7f0c6c14b540 2024-01-24T12:44:27.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c6b7fe640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c6001d3a0 tx=0x7f0c6001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.607+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600ba600 con 0x7f0c6c14b540 2024-01-24T12:44:27.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600ba760 con 0x7f0c6c14b540 2024-01-24T12:44:27.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c0b9a00 con 0x7f0c6c14b540 2024-01-24T12:44:27.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600bab10 con 0x7f0c6c14b540 2024-01-24T12:44:27.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c0a3400 con 0x7f0c6c14b540 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0b9b90 con 0x7f0c6c14b540 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c600bac70 con 0x7f0c6c14b540 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c68ff9640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 0x7f0c58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c60121740 con 0x7f0c6c14b540 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c6bfff640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 0x7f0c58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.611+0000 7f0c6bfff640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 0x7f0c58067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.615+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0c600ef0f0 con 0x7f0c6c14b540 2024-01-24T12:44:27.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.775+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6c04e000 con 0x7f0c6c14b540 2024-01-24T12:44:27.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.775+0000 7f0c68ff9640 1 -- 172.21.15.27:0/1178151609 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f0c600b5090 con 0x7f0c6c14b540 2024-01-24T12:44:27.778 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:27.778 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 msgr2=0x7f0c58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 0x7f0c58067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 msgr2=0x7f0c6c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c6001d3a0 tx=0x7f0c6001ba90 comp rx=0 tx=0).stop 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 shutdown_connections 2024-01-24T12:44:27.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0c58065a60 0x7f0c58067f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0c6c14dfd0 0x7f0c6c0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c6c14b540 0x7f0c6c0a3ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 --2- 172.21.15.27:0/1178151609 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0c6c06a4c0 0x7f0c6c1d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 >> 172.21.15.27:0/1178151609 conn(0x7f0c6c0c02e0 msgr2=0x7f0c6c148290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 shutdown_connections 2024-01-24T12:44:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.779+0000 7f0c72a24640 1 -- 172.21.15.27:0/1178151609 wait complete. 2024-01-24T12:44:27.797 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.915+0000 7fd781897640 1 Processor -- start 2024-01-24T12:44:27.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.915+0000 7fd781897640 1 -- start start 2024-01-24T12:44:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd781897640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 0x7fd77c070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd781897640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd77c071a20 0x7fd77c147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd781897640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0b2c80 con 0x7fd77c06eca0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd781897640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c06fdb0 con 0x7fd77c071a20 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd781897640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c070370 con 0x7fd77c0708d0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd77c06eca0 0x7fd77c1440d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40716/0 (socket says 172.21.15.27:40716) 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 -- 172.21.15.27:0/1104261794 learned_addr learned my addr 172.21.15.27:0/1104261794 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77affd640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 0x7fd77c070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77a7fc640 1 --2- 172.21.15.27:0/1104261794 >> v2:172.21.15.124:3300/0 conn(0x7fd77c071a20 0x7fd77c147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288903673 0 0) 0x7fd77c0b2c80 con 0x7fd77c06eca0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd764005740 con 0x7fd77c06eca0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3109206154 0 0) 0x7fd764005740 con 0x7fd77c06eca0 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 msgr2=0x7fd77c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 0x7fd77c070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 >> v2:172.21.15.124:3300/0 conn(0x7fd77c071a20 msgr2=0x7fd77c147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 --2- 172.21.15.27:0/1104261794 >> v2:172.21.15.124:3300/0 conn(0x7fd77c071a20 0x7fd77c147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0b2ed0 con 0x7fd77c06eca0 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fd774001a00 con 0x7fd77c06eca0 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 >> v1:172.21.15.27:6789/0 conn(0x7fd77c06eca0 legacy=0x7fd77c1440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd764005b90 0x7fd764005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 0x7fd7640069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd764006f20 0x7fd7640073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c06fdb0 con 0x7fd764006f20 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c070370 con 0x7fd764005b90 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76400dba0 con 0x7fd77c0708d0 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd764006f20 0x7fd7640073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77affd640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd764005b90 0x7fd764005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 -- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 msgr2=0x7fd7640069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c0708d0 0x7fd7640069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 -- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd764005b90 msgr2=0x7fd764005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd764005b90 0x7fd764005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 -- 172.21.15.27:0/1104261794 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764005740 con 0x7fd764006f20 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd77b7fe640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd764006f20 0x7fd7640073a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd77400a860 tx=0x7fd77401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30129451674548ab server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740ad630 con 0x7fd764006f20 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7740a8070 con 0x7fd764006f20 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.919+0000 7fd779ffb640 1 -- 172.21.15.27:0/1104261794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740ad9f0 con 0x7fd764006f20 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/1104261794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd764006f20 msgr2=0x7fd7640073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 --2- 172.21.15.27:0/1104261794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd764006f20 0x7fd7640073a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd77400a860 tx=0x7fd77401d360 comp rx=0 tx=0).stop 2024-01-24T12:44:27.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77b7fe640 1 -- 172.21.15.27:0/1104261794 reap_dead start 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/1104261794 shutdown_connections 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/1104261794 >> 172.21.15.27:0/1104261794 conn(0x7fd77c069ef0 msgr2=0x7fd77c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/1104261794 shutdown_connections 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/1104261794 wait complete. 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 Processor -- start 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- start start 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c145f40 0x7fd77c1cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd77c0b3b30 0x7fd77c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1cf7e0 con 0x7fd77c1cecd0 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1cf220 con 0x7fd77c0b3b30 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1cfa80 con 0x7fd77c145f40 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56074/0 (socket says 172.21.15.27:56074) 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 -- 172.21.15.27:0/3943679052 learned_addr learned my addr 172.21.15.27:0/3943679052 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77affd640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c145f40 0x7fd77c1cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77b7fe640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd77c0b3b30 0x7fd77c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 -- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c145f40 msgr2=0x7fd77c1cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c145f40 0x7fd77c1cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 -- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd77c0b3b30 msgr2=0x7fd77c0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd77c0b3b30 0x7fd77c0b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 -- 172.21.15.27:0/3943679052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c1cd020 con 0x7fd77c1cecd0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd77a7fc640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd770009fd0 tx=0x7fd77000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000eea0 con 0x7fd77c1cecd0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000c940 con 0x7fd77c1cecd0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c146320 con 0x7fd77c1cecd0 2024-01-24T12:44:27.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000ccf0 con 0x7fd77c1cecd0 2024-01-24T12:44:27.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c0b58d0 con 0x7fd77c1cecd0 2024-01-24T12:44:27.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.923+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c1cf640 con 0x7fd77c1cecd0 2024-01-24T12:44:27.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.927+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd770013470 con 0x7fd77c1cecd0 2024-01-24T12:44:27.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.927+0000 7fd763fff640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 0x7fd768067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:27.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.927+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd770083820 con 0x7fd77c1cecd0 2024-01-24T12:44:27.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.927+0000 7fd77affd640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 0x7fd768067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:27.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.927+0000 7fd77affd640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 0x7fd768067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009a30 tx=0x7fd76c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:27.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:27.931+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd7700512c0 con 0x7fd77c1cecd0 2024-01-24T12:44:28.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.123+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd77c1cf640 con 0x7fd77c1cecd0 2024-01-24T12:44:28.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.123+0000 7fd763fff640 1 -- 172.21.15.27:0/3943679052 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7fd77c1cf640 con 0x7fd77c1cecd0 2024-01-24T12:44:28.128 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:28.128 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 msgr2=0x7fd768067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 0x7fd768067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009a30 tx=0x7fd76c008040 comp rx=0 tx=0).stop 2024-01-24T12:44:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 msgr2=0x7fd77c1cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd770009fd0 tx=0x7fd77000ec50 comp rx=0 tx=0).stop 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 shutdown_connections 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd768065a90 0x7fd768067f50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd77c0b3b30 0x7fd77c0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd77c1cecd0 0x7fd77c1cdce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 --2- 172.21.15.27:0/3943679052 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd77c145f40 0x7fd77c1cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 >> 172.21.15.27:0/3943679052 conn(0x7fd77c069ef0 msgr2=0x7fd77c0bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 shutdown_connections 2024-01-24T12:44:28.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.127+0000 7fd781897640 1 -- 172.21.15.27:0/3943679052 wait complete. 2024-01-24T12:44:28.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T12:44:11.284933+0000', 'modified': '2024-01-24T12:44:13.946696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/3678556812', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 3678556812}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 3678556812}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-24T12:44:28.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T12:44:28.447 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-24T12:44:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 Processor -- start 2024-01-24T12:44:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 -- start start 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3fd8070010 0x7f3fd8070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8071180 con 0x7f3fd8071610 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd80b9c10 con 0x7f3fd8141700 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fde87f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd80ba1d0 con 0x7f3fd8070010 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3fd8071610 0x7f3fd8147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40720/0 (socket says 172.21.15.27:40720) 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd77fe640 1 -- 172.21.15.27:0/468305036 learned_addr learned my addr 172.21.15.27:0/468305036 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/468305036 >> v2:172.21.15.124:3300/0 conn(0x7f3fd8070010 0x7f3fd8070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817458952 0 0) 0x7f3fd8071180 con 0x7f3fd8071610 2024-01-24T12:44:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc4003530 con 0x7f3fd8071610 2024-01-24T12:44:28.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056295370 0 0) 0x7f3fc4003530 con 0x7f3fd8071610 2024-01-24T12:44:28.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 >> v2:172.21.15.124:3300/0 conn(0x7f3fd8070010 msgr2=0x7f3fd8070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 --2- 172.21.15.27:0/468305036 >> v2:172.21.15.124:3300/0 conn(0x7f3fd8070010 0x7f3fd8070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 >> v1:172.21.15.124:6789/0 conn(0x7f3fd8141700 legacy=0x7f3fd8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd80b9ef0 con 0x7f3fd8071610 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f3fc0001680 con 0x7f3fd8071610 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 >> v1:172.21.15.27:6789/0 conn(0x7f3fd8071610 legacy=0x7f3fd8147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fc4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fc40047d0 0x7f3fc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fc4005190 0x7f3fc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80ba1d0 con 0x7f3fc40039d0 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc400c090 con 0x7f3fc4005190 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc400c250 con 0x7f3fc40047d0 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fc4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fc40047d0 0x7f3fc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 -- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fc40047d0 msgr2=0x7f3fc4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fc40047d0 0x7f3fc4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 -- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fc4005190 msgr2=0x7f3fc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fc4005190 0x7f3fc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fc4005190 0x7f3fc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fd7fff640 1 -- 172.21.15.27:0/468305036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4003530 con 0x7f3fc40039d0 2024-01-24T12:44:28.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fc4005190 0x7f3fc400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.583+0000 7f3fdce1c640 1 -- 172.21.15.27:0/468305036 reap_dead start 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fc4003df0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fd001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86419d8e62c3da5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00a5510 con 0x7f3fc40039d0 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd00a5670 con 0x7f3fc40039d0 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fd6ffd640 1 -- 172.21.15.27:0/468305036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00a5a00 con 0x7f3fc40039d0 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 msgr2=0x7f3fc4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fc4003df0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fd001ca30 comp rx=0 tx=0).stop 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- 172.21.15.27:0/468305036 shutdown_connections 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 --2- 172.21.15.27:0/468305036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fc4003df0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- 172.21.15.27:0/468305036 >> 172.21.15.27:0/468305036 conn(0x7f3fd806ae30 msgr2=0x7f3fd806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- 172.21.15.27:0/468305036 shutdown_connections 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- 172.21.15.27:0/468305036 wait complete. 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 Processor -- start 2024-01-24T12:44:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.587+0000 7f3fde87f640 1 -- start start 2024-01-24T12:44:28.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fd81d9fa0 0x7f3fd80b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fd80b5d40 0x7f3fd813c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81d60b0 con 0x7f3fc40039d0 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81d5780 con 0x7f3fd80b5d40 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81d5a60 con 0x7f3fd81d9fa0 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56100/0 (socket says 172.21.15.27:56100) 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 -- 172.21.15.27:0/2364650072 learned_addr learned my addr 172.21.15.27:0/2364650072 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 -- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fd81d9fa0 msgr2=0x7f3fd80b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fd81d9fa0 0x7f3fd80b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 -- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fd80b5d40 msgr2=0x7f3fd813c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fd80b5d40 0x7f3fd813c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 -- 172.21.15.27:0/2364650072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd81d5d40 con 0x7f3fc40039d0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fd001c860 tx=0x7f3fd00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 -- 172.21.15.27:0/2364650072 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00a5510 con 0x7f3fc40039d0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 -- 172.21.15.27:0/2364650072 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd00ad440 con 0x7f3fc40039d0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd80b70b0 con 0x7f3fc40039d0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 -- 172.21.15.27:0/2364650072 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00ad7b0 con 0x7f3fc40039d0 2024-01-24T12:44:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd80b6d10 con 0x7f3fc40039d0 2024-01-24T12:44:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 -- 172.21.15.27:0/2364650072 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fd00b4040 con 0x7f3fc40039d0 2024-01-24T12:44:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 0x7f3fb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd4ff9640 1 -- 172.21.15.27:0/2364650072 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fd011d300 con 0x7f3fc40039d0 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 0x7f3fb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fe19a8000 1 Processor -- start 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.591+0000 7f3fe19a8000 1 -- start start 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 0x7f3fb8067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fd814ba50 tx=0x7f3fc0000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3f9e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3fa96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3dbf350 con 0x5561b3f70a90 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3dbc920 con 0x5561b3f9ed30 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b3db8210 con 0x5561b3f9e410 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56104/0 (socket says 172.21.15.27:56104) 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/4275249913 learned_addr learned my addr 172.21.15.27:0/4275249913 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3f9e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3fa96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 msgr2=0x5561b3f9e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3f9e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 msgr2=0x5561b3fa96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3fa96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/4275249913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b3d58ff0 con 0x5561b3f70a90 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3f9e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3fa96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00f64c0 tx=0x7f3fd00ee4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d304baab6ae72104 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fcdffb640 1 -- 172.21.15.27:0/4275249913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00f69f0 con 0x5561b3f70a90 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fcdffb640 1 -- 172.21.15.27:0/4275249913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd011d0c0 con 0x5561b3f70a90 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fcdffb640 1 -- 172.21.15.27:0/4275249913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0009690 con 0x5561b3f70a90 2024-01-24T12:44:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- 172.21.15.27:0/4275249913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 msgr2=0x5561b3f9c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00f64c0 tx=0x7f3fd00ee4e0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- 172.21.15.27:0/4275249913 shutdown_connections 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3fa96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3f9e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/4275249913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f9c8e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- 172.21.15.27:0/4275249913 >> 172.21.15.27:0/4275249913 conn(0x5561b3e6d430 msgr2=0x5561b3f9c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- 172.21.15.27:0/4275249913 shutdown_connections 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- 172.21.15.27:0/4275249913 wait complete. 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- start start 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 Processor -- start 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9e410 0x5561b3f6f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9ed30 0x5561b3f6fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3d57420 con 0x5561b3f70a90 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3d75890 con 0x5561b3f9e410 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b3a75940 con 0x5561b3f9ed30 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fe19a8000 10 client.0 _ll_register_callbacks cb 0x5561b3dacf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56112/0 (socket says 172.21.15.27:56112) 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/1524362942 learned_addr learned my addr 172.21.15.27:0/1524362942 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9ed30 0x5561b3f6fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9e410 0x5561b3f6f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9ed30 msgr2=0x5561b3f6fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9ed30 0x5561b3f6fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9e410 msgr2=0x5561b3f6f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9e410 0x5561b3f6f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 -- 172.21.15.27:0/1524362942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd80b6d10 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00ee7c0 tx=0x7f3fd0006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f037c9dffc8aa33 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.595+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00ecc80 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fd00eed20 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561b3d7dcc0 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fd00eeee0 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 10 client.4674 fetch_fsmap learned FSMap version 7 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5561b3ab4890 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561b3d7dcc0 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3fd00edfb0 con 0x5561b3f70a90 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 20 client.4674 populate_metadata read hostname 'smithi027' 2024-01-24T12:44:28.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3fb24f0 0x5561b3fb48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 4 client.4674 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T12:44:28.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 --> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561b3db6b60 con 0x5561b3fb24f0 2024-01-24T12:44:28.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3fb24f0 0x5561b3fb48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 10 client.4674 ms_handle_connect on v2:172.21.15.27:6833/3678556812 2024-01-24T12:44:28.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3fb24f0 0x5561b3fb48e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b242cecbb724ef03 server_cookie=1b168f4c5fd9ef0d in_seq=0 out_seq=0 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/1524362942 <== mds.0 v2:172.21.15.27:6833/3678556812 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5561b3db6b60 con 0x5561b3fb24f0 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 10 client.4674 handle_command_reply: tid=0 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 client.4674 shutdown 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 msgr2=0x5561b3f6f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00ee7c0 tx=0x7f3fd0006f50 comp rx=0 tx=0).stop 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 shutdown_connections 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3fb24f0 0x5561b3fb48e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9ed30 0x5561b3f6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9e410 0x5561b3f6f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1524362942 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f70a90 0x5561b3f6f040 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fb6ffd640 0 client.4674 ms_handle_reset on v2:172.21.15.27:6833/3678556812 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 >> 172.21.15.27:0/1524362942 conn(0x5561b3e6d430 msgr2=0x5561b3f67f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 shutdown_connections 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1524362942 wait complete. 2024-01-24T12:44:28.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.599+0000 7f3fe19a8000 20 client.4674 trim_cache size 0 max 16384 2024-01-24T12:44:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 Processor -- start 2024-01-24T12:44:28.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- start start 2024-01-24T12:44:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f70a90 0x5561b3ff7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.617 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3ff8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3a75940 con 0x5561b3f9e410 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3f61c60 con 0x5561b3f9ed30 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b3db3b80 con 0x5561b3f70a90 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56128/0 (socket says 172.21.15.27:56128) 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 -- 172.21.15.27:0/1380491599 learned_addr learned my addr 172.21.15.27:0/1380491599 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 -- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f70a90 msgr2=0x5561b3ff7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f70a90 0x5561b3ff7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 -- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 msgr2=0x5561b3ff8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3ff8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 -- 172.21.15.27:0/1380491599 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b3d7d2d0 con 0x5561b3f9e410 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0005fd0 tx=0x7f3fc0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a25ebe656e4510 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fce7fc640 1 -- 172.21.15.27:0/1380491599 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc001a040 con 0x5561b3f9e410 2024-01-24T12:44:28.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fce7fc640 1 -- 172.21.15.27:0/1380491599 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc001b040 con 0x5561b3f9e410 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fce7fc640 1 -- 172.21.15.27:0/1380491599 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0023a80 con 0x5561b3f9e410 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1380491599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 msgr2=0x5561b3ff8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0005fd0 tx=0x7f3fc0012000 comp rx=0 tx=0).stop 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1380491599 shutdown_connections 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f9ed30 0x5561b3ff8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9e410 0x5561b3ff8220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/1380491599 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f70a90 0x5561b3ff7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1380491599 >> 172.21.15.27:0/1380491599 conn(0x5561b3e6d430 msgr2=0x5561b3f9c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1380491599 shutdown_connections 2024-01-24T12:44:28.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- 172.21.15.27:0/1380491599 wait complete. 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 -- start start 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.615+0000 7f3fe19a8000 1 Processor -- start 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 0x5561b3ffcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3ffd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3d57420 con 0x5561b3f9ed30 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b3d6baa0 con 0x5561b3f70a90 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b3d43410 con 0x5561b3f9e410 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 10 client.0 _ll_register_callbacks cb 0x5561b3e088d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56136/0 (socket says 172.21.15.27:56136) 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 -- 172.21.15.27:0/586981780 learned_addr learned my addr 172.21.15.27:0/586981780 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3ffd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 0x5561b3ffcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 -- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 msgr2=0x5561b3ffd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3ffd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 -- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 msgr2=0x5561b3ffcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 0x5561b3ffcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 -- 172.21.15.27:0/586981780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc000f040 con 0x5561b3f9ed30 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd77fe640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3ffd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 0x5561b3ffcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fdce1c640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8141ae0 tx=0x7f3fc80106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bb1dccbe59eef5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8003d90 con 0x5561b3f9ed30 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fc800c050 con 0x5561b3f9ed30 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561b3faf6d0 con 0x5561b3f9ed30 2024-01-24T12:44:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc8010e50 con 0x5561b3f9ed30 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 10 client.4680 fetch_fsmap learned FSMap version 7 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5561b3d63420 con 0x5561b3f9ed30 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561b3faf6d0 con 0x5561b3f9ed30 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3fc8012040 con 0x5561b3f9ed30 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 20 client.4680 populate_metadata read hostname 'smithi027' 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3ff6d10 0x5561b3ff70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 4 client.4680 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 --> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561b3d71a00 con 0x5561b3ff6d10 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3ff6d10 0x5561b3ff70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fd7fff640 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3ff6d10 0x5561b3ff70f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a864da00c8b7ff90 server_cookie=521051b112868af0 in_seq=0 out_seq=0 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 10 client.4680 ms_handle_connect on v2:172.21.15.27:6833/3678556812 2024-01-24T12:44:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 1 -- 172.21.15.27:0/586981780 <== mds.0 v2:172.21.15.27:6833/3678556812 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5561b3d71a00 con 0x5561b3ff6d10 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 10 client.4680 handle_command_reply: tid=0 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 client.4680 shutdown 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 msgr2=0x5561b3ffd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8141ae0 tx=0x7f3fc80106d0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 shutdown_connections 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:6833/3678556812,v1:172.21.15.27:6835/3678556812] conn(0x5561b3ff6d10 0x5561b3ff70f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5561b3f9ed30 0x5561b3ffd9c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x5561b3f9e410 0x5561b3ffd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fb6ffd640 0 client.4680 ms_handle_reset on v2:172.21.15.27:6833/3678556812 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 --2- 172.21.15.27:0/586981780 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x5561b3f70a90 0x5561b3ffcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 >> 172.21.15.27:0/586981780 conn(0x5561b3e6d430 msgr2=0x5561b3f9c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 shutdown_connections 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 1 -- 172.21.15.27:0/586981780 wait complete. 2024-01-24T12:44:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fe19a8000 20 client.4680 trim_cache size 0 max 16384 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98", 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4260, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 17.333605933000001, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 7, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 20, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 20, 2024-01-24T12:44:28.627 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 23.283665489000001 2024-01-24T12:44:28.628 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T12:44:28.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 msgr2=0x7f3fb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 0x7f3fb8067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fd814ba50 tx=0x7f3fc0000ee0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 msgr2=0x7f3fd81d6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fd001c860 tx=0x7f3fd00197d0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 shutdown_connections 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3fb8065a60 0x7f3fb8067f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3fd80b5d40 0x7f3fd813c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3fd81d9fa0 0x7f3fd80b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 --2- 172.21.15.27:0/2364650072 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3fc40039d0 0x7f3fd81d6540 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 >> 172.21.15.27:0/2364650072 conn(0x7f3fd806ae30 msgr2=0x7f3fd8146ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 shutdown_connections 2024-01-24T12:44:28.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.619+0000 7f3fde87f640 1 -- 172.21.15.27:0/2364650072 wait complete. 2024-01-24T12:44:28.639 INFO:teuthology.run_tasks:Running task kclient... 2024-01-24T12:44:28.666 INFO:tasks.kclient:Mounting kernel clients... 2024-01-24T12:44:28.667 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-24T12:44:28.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:28.667 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-24T12:44:28.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:28.678 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-01-24T12:44:28.745 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-01-24T12:44:28.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T12:44:28.748 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-01-24T12:44:28.748 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-24T12:44:28.748 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:28.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T12:44:28.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 Processor -- start 2024-01-24T12:44:28.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 -- start start 2024-01-24T12:44:28.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa65414b540 0x7fa6540bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65406a4c0 0x7fa65406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540bc590 con 0x7fa65414dfd0 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65406ae40 con 0x7fa65414b540 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6597b7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540bc320 con 0x7fa65406a4c0 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa65414b540 0x7fa6540bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa65414b540 0x7fa6540bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56148/0 (socket says 172.21.15.27:56148) 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 -- 172.21.15.27:0/1912620429 learned_addr learned my addr 172.21.15.27:0/1912620429 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa6527fc640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65406a4c0 0x7fa65406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 -- 172.21.15.27:0/1912620429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65406a4c0 msgr2=0x7fa65406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65406a4c0 0x7fa65406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 -- 172.21.15.27:0/1912620429 >> v1:172.21.15.124:6789/0 conn(0x7fa65414dfd0 legacy=0x7fa65414e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:28.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 -- 172.21.15.27:0/1912620429 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540b3a10 con 0x7fa65414b540 2024-01-24T12:44:28.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa652ffd640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6540bac60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa644009870 tx=0x7fa64401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f918b2a5a49be4a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa651ffb640 1 -- 172.21.15.27:0/1912620429 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440a89b0 con 0x7fa65414b540 2024-01-24T12:44:28.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa651ffb640 1 -- 172.21.15.27:0/1912620429 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6440a8b10 con 0x7fa65414b540 2024-01-24T12:44:28.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.879+0000 7fa651ffb640 1 -- 172.21.15.27:0/1912620429 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440a8ea0 con 0x7fa65414b540 2024-01-24T12:44:28.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/1912620429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 msgr2=0x7fa6540bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6540bac60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa644009870 tx=0x7fa64401ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/1912620429 shutdown_connections 2024-01-24T12:44:28.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65406a4c0 0x7fa65406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- 172.21.15.27:0/1912620429 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6540bac60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/1912620429 >> 172.21.15.27:0/1912620429 conn(0x7fa6540c02e0 msgr2=0x7fa6540c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/1912620429 shutdown_connections 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/1912620429 wait complete. 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 Processor -- start 2024-01-24T12:44:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- start start 2024-01-24T12:44:28.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 0x7fa654146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65414dfd0 0x7fa654144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541468c0 con 0x7fa65414b540 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540b56f0 con 0x7fa65406a4c0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540b59d0 con 0x7fa65414dfd0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:56154/0 (socket says 172.21.15.27:56154) 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 -- 172.21.15.27:0/4156013196 learned_addr learned my addr 172.21.15.27:0/4156013196 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6537fe640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65414dfd0 0x7fa654144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa652ffd640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 0x7fa654146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 -- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65414dfd0 msgr2=0x7fa654144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65414dfd0 0x7fa654144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 -- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 msgr2=0x7fa654146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 0x7fa654146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 -- 172.21.15.27:0/4156013196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440094d0 con 0x7fa65414b540 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa652ffd640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 0x7fa654146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6527fc640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa64800d800 tx=0x7fa64800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800b6c0 con 0x7fa65414b540 2024-01-24T12:44:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800b820 con 0x7fa65414b540 2024-01-24T12:44:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800bb90 con 0x7fa65414b540 2024-01-24T12:44:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6540b5cb0 con 0x7fa65414b540 2024-01-24T12:44:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.883+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6540a3760 con 0x7fa65414b540 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6540bfa00 con 0x7fa65414b540 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa64800bcf0 con 0x7fa65414b540 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa63b7fe640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 0x7fa640067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6480837b0 con 0x7fa65414b540 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa652ffd640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 0x7fa640067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.887+0000 7fa652ffd640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 0x7fa640067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6440b2000 tx=0x7fa6440aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:28.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:28.891+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fa6480510e0 con 0x7fa65414b540 2024-01-24T12:44:29.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.083+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa65404e000 con 0x7fa65414b540 2024-01-24T12:44:29.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa63b7fe640 1 -- 172.21.15.27:0/4156013196 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa648011340 con 0x7fa65414b540 2024-01-24T12:44:29.087 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T12:44:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 msgr2=0x7fa640067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 0x7fa640067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6440b2000 tx=0x7fa6440aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 msgr2=0x7fa6541444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa64800d800 tx=0x7fa64800dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 shutdown_connections 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa640065a60 0x7fa640067f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa65414dfd0 0x7fa654144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa65414b540 0x7fa6541444e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 --2- 172.21.15.27:0/4156013196 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa65406a4c0 0x7fa654146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 >> 172.21.15.27:0/4156013196 conn(0x7fa6540c02e0 msgr2=0x7fa654149cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 shutdown_connections 2024-01-24T12:44:29.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:29.087+0000 7fa6597b7640 1 -- 172.21.15.27:0/4156013196 wait complete. 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T12:44:29.107 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T12:44:29.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.108 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:29.117 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42509sec preferred_lft 42509sec 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-01-24T12:44:29.118 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:29.119 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T12:44:29.119 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:03:49:d7:b4 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:29.119 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T12:44:29.119 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:29.120 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-24T12:44:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-24T12:44:29.121 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:29.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.234 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T12:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-01-24T12:44:29.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.255 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T12:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-24T12:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T12:44:29.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-24T12:44:29.330 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:29.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.423 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-24T12:44:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.432 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-01-24T12:44:29.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.486 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:29.486 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:29.486 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T12:44:29.486 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-24T12:44:29.486 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:29.568 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-24T12:44:29.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.568 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:29.568 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-24T12:44:29.569 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:29.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.725 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:29.725 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:29.725 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-01-24T12:44:29.725 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-01-24T12:44:29.725 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:29.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T12:44:29.765 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:29.817 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T12:44:29.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T12:44:29.817 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:29.872 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-24T12:44:29.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:29.873 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:29.969 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:29.969 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:29.969 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:30.441 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:30.441 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:30.441 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:30.441 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.124:3300,172.21.15.124:3301" 2024-01-24T12:44:30.441 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-24T12:44:30.458 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:30.458 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:30.458 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:30.458 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.124:3300,172.21.15.124:3301" 2024-01-24T12:44:30.458 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-24T12:44:30.459 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.124:6789,172.21.15.124:6790" 2024-01-24T12:44:30.459 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.124:6789,172.21.15.124:6790:/ 2024-01-24T12:44:30.459 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98" will pass to kernel 2024-01-24T12:44:30.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-24T12:44:30.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:30.463 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:30.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:30.483 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-24T12:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout:client4689 2024-01-24T12:44:30.566 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:44:30.566 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T12:44:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:30.621 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-24T12:44:30.699 INFO:teuthology.orchestra.run.smithi195.stdout:client4689 2024-01-24T12:44:30.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:30.700 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-24T12:44:30.778 INFO:teuthology.orchestra.run.smithi195.stdout:client4689 2024-01-24T12:44:30.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:30.779 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98.client4689/status') 2024-01-24T12:44:30.853 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.4689 (3)172.21.15.195:0/1816833080 2024-01-24T12:44:30.854 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-01-24T12:44:30.854 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-01-24T12:44:30.854 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-01-24T12:44:30.854 INFO:teuthology.orchestra.run.smithi195.stderr:71 bytes copied, 7.2678e-05 s, 977 kB/s 2024-01-24T12:44:30.856 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-24T12:44:30.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.019+0000 7fb112fbb640 1 Processor -- start 2024-01-24T12:44:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.019+0000 7fb112fbb640 1 -- start start 2024-01-24T12:44:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb112fbb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb10c0bc340 0x7fb10c142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb112fbb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb112fbb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c071770 con 0x7fb10c142d50 2024-01-24T12:44:31.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb112fbb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0b37e0 con 0x7fb10c0bc340 2024-01-24T12:44:31.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb112fbb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0b3ac0 con 0x7fb10c149470 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb110d57640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb10c0bc340 0x7fb10c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:49746/0 (socket says 172.21.15.27:49746) 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb10bfff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7fb10c142d50 0x7fb10c148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:35046/0 (socket says 172.21.15.27:35046) 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 -- 172.21.15.27:0/3728360144 learned_addr learned my addr 172.21.15.27:0/3728360144 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 -- 172.21.15.27:0/3728360144 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0bc340 msgr2=0x7fb10c142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 --2- 172.21.15.27:0/3728360144 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0bc340 0x7fb10c142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 -- 172.21.15.27:0/3728360144 >> v1:172.21.15.124:6789/0 conn(0x7fb10c142d50 legacy=0x7fb10c148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.023+0000 7fb111558640 1 -- 172.21.15.27:0/3728360144 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0b3da0 con 0x7fb10c149470 2024-01-24T12:44:31.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb111558640 1 --2- 172.21.15.27:0/3728360144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb104009e50 tx=0x7fb10401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a213b9aef560e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb10b7fe640 1 -- 172.21.15.27:0/3728360144 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040af400 con 0x7fb10c149470 2024-01-24T12:44:31.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb10b7fe640 1 -- 172.21.15.27:0/3728360144 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1040ab050 con 0x7fb10c149470 2024-01-24T12:44:31.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb10b7fe640 1 -- 172.21.15.27:0/3728360144 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040af780 con 0x7fb10c149470 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- 172.21.15.27:0/3728360144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 msgr2=0x7fb10c153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 --2- 172.21.15.27:0/3728360144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb104009e50 tx=0x7fb10401f1f0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- 172.21.15.27:0/3728360144 shutdown_connections 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 --2- 172.21.15.27:0/3728360144 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c149470 0x7fb10c153110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 --2- 172.21.15.27:0/3728360144 >> v2:172.21.15.124:3300/0 conn(0x7fb10c0bc340 0x7fb10c142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- 172.21.15.27:0/3728360144 >> 172.21.15.27:0/3728360144 conn(0x7fb10c069ef0 msgr2=0x7fb10c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- 172.21.15.27:0/3728360144 shutdown_connections 2024-01-24T12:44:31.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- 172.21.15.27:0/3728360144 wait complete. 2024-01-24T12:44:31.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 Processor -- start 2024-01-24T12:44:31.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.027+0000 7fb112fbb640 1 -- start start 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 0x7fb10c1374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c13bc70 0x7fb10c1356a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c13c750 con 0x7fb10c0bc340 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c137e20 con 0x7fb10c149470 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c139740 con 0x7fb10c13bc70 2024-01-24T12:44:31.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54102/0 (socket says 172.21.15.27:54102) 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 -- 172.21.15.27:0/2721176958 learned_addr learned my addr 172.21.15.27:0/2721176958 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb111558640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c13bc70 0x7fb10c1356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb10bfff640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 0x7fb10c1374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 -- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c13bc70 msgr2=0x7fb10c1356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c13bc70 0x7fb10c1356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 -- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 msgr2=0x7fb10c1374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 0x7fb10c1374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 -- 172.21.15.27:0/2721176958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104009b30 con 0x7fb10c0bc340 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb10bfff640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 0x7fb10c1374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb110d57640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb10000e930 tx=0x7fb10000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100009690 con 0x7fb10c0bc340 2024-01-24T12:44:31.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000c9a0 con 0x7fb10c0bc340 2024-01-24T12:44:31.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c13c190 con 0x7fb10c0bc340 2024-01-24T12:44:31.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000cd10 con 0x7fb10c0bc340 2024-01-24T12:44:31.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c136f80 con 0x7fb10c0bc340 2024-01-24T12:44:31.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c04e000 con 0x7fb10c0bc340 2024-01-24T12:44:31.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb100013470 con 0x7fb10c0bc340 2024-01-24T12:44:31.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 0x7fb0f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1000833d0 con 0x7fb10c0bc340 2024-01-24T12:44:31.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.031+0000 7fb10bfff640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 0x7fb0f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.035+0000 7fb10bfff640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 0x7fb0f8067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb10c13b500 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.035+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb100050e50 con 0x7fb10c0bc340 2024-01-24T12:44:31.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.191+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb10c148810 con 0x7fb10c0bc340 2024-01-24T12:44:31.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb1097fa640 1 -- 172.21.15.27:0/2721176958 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fb100054470 con 0x7fb10c0bc340 2024-01-24T12:44:31.196 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:31.196 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 msgr2=0x7fb0f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 0x7fb0f8067f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb10c13b500 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 msgr2=0x7fb10c139200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb10000e930 tx=0x7fb10000edf0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 shutdown_connections 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb0f8065a60 0x7fb0f8067f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb10c13bc70 0x7fb10c1356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb10c149470 0x7fb10c1374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 --2- 172.21.15.27:0/2721176958 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10c0bc340 0x7fb10c139200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 >> 172.21.15.27:0/2721176958 conn(0x7fb10c069ef0 msgr2=0x7fb10c13e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 shutdown_connections 2024-01-24T12:44:31.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.195+0000 7fb112fbb640 1 -- 172.21.15.27:0/2721176958 wait complete. 2024-01-24T12:44:31.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:31.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:31.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 Processor -- start 2024-01-24T12:44:31.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 -- start start 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8aa40b8df0 0x7f8aa4142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8aa4142d80 0x7f8aa41531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa4148a80 con 0x7f8aa40b8540 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40b3890 con 0x7f8aa4142d80 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aab4e3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40b3b70 con 0x7f8aa40b8df0 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8aa4142d80 0x7f8aa41531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8aa4142d80 0x7f8aa41531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54104/0 (socket says 172.21.15.27:54104) 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 -- 172.21.15.27:0/2535436004 learned_addr learned my addr 172.21.15.27:0/2535436004 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa927f640 1 --2- 172.21.15.27:0/2535436004 >> v2:172.21.15.124:3300/0 conn(0x7f8aa40b8df0 0x7f8aa4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 -- 172.21.15.27:0/2535436004 >> v2:172.21.15.124:3300/0 conn(0x7f8aa40b8df0 msgr2=0x7f8aa4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:31.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 --2- 172.21.15.27:0/2535436004 >> v2:172.21.15.124:3300/0 conn(0x7f8aa40b8df0 0x7f8aa4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 -- 172.21.15.27:0/2535436004 >> v1:172.21.15.124:6789/0 conn(0x7f8aa40b8540 legacy=0x7f8aa4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.335+0000 7f8aa9a80640 1 -- 172.21.15.27:0/2535436004 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40b3e50 con 0x7f8aa4142d80 2024-01-24T12:44:31.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa9a80640 1 --2- 172.21.15.27:0/2535436004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa4142d80 0x7f8aa41531b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40b9a80 tx=0x7f8a9c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecada3ed45413b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8a9bfff640 1 -- 172.21.15.27:0/2535436004 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4071930 con 0x7f8aa4142d80 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8a9bfff640 1 -- 172.21.15.27:0/2535436004 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0a58b0 con 0x7f8aa4142d80 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8a9bfff640 1 -- 172.21.15.27:0/2535436004 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0a5c40 con 0x7f8aa4142d80 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- 172.21.15.27:0/2535436004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa4142d80 msgr2=0x7f8aa41531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/2535436004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa4142d80 0x7f8aa41531b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40b9a80 tx=0x7f8a9c01c9d0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- 172.21.15.27:0/2535436004 shutdown_connections 2024-01-24T12:44:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/2535436004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa4142d80 0x7f8aa41531b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/2535436004 >> v2:172.21.15.124:3300/0 conn(0x7f8aa40b8df0 0x7f8aa4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- 172.21.15.27:0/2535436004 >> 172.21.15.27:0/2535436004 conn(0x7f8aa406a120 msgr2=0x7f8aa406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- 172.21.15.27:0/2535436004 shutdown_connections 2024-01-24T12:44:31.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- 172.21.15.27:0/2535436004 wait complete. 2024-01-24T12:44:31.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 Processor -- start 2024-01-24T12:44:31.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- start start 2024-01-24T12:44:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 0x7f8aa41410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8aa4142d80 0x7f8aa413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40bba90 con 0x7f8aa40b8df0 2024-01-24T12:44:31.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa413c0a0 con 0x7f8aa4142d80 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aab4e3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa413e3d0 con 0x7f8aa40b8540 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54120/0 (socket says 172.21.15.27:54120) 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 -- 172.21.15.27:0/3045282779 learned_addr learned my addr 172.21.15.27:0/3045282779 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa927f640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 0x7f8aa41410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa9a80640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8aa4142d80 0x7f8aa413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 -- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 msgr2=0x7f8aa41410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 0x7f8aa41410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 -- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8aa4142d80 msgr2=0x7f8aa413f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8aa4142d80 0x7f8aa413f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 -- 172.21.15.27:0/3045282779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009b30 con 0x7f8aa40b8df0 2024-01-24T12:44:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa927f640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 0x7f8aa41410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.339+0000 7f8aa8a7e640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c500 tx=0x7f8a9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94005220 con 0x7f8aa40b8df0 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94005380 con 0x7f8aa40b8df0 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa4141740 con 0x7f8aa40b8df0 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94007270 con 0x7f8aa40b8df0 2024-01-24T12:44:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4141d00 con 0x7f8aa40b8df0 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4141b60 con 0x7f8aa40b8df0 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a940073d0 con 0x7f8aa40b8df0 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 0x7f8a88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a94082af0 con 0x7f8aa40b8df0 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8aa927f640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 0x7f8a88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.343+0000 7f8aa927f640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 0x7f8a88067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0007a70 tx=0x7f8aa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.347+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8aa4141b60 con 0x7f8aa40b8df0 2024-01-24T12:44:31.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.507+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8aa4141b60 con 0x7f8aa40b8df0 2024-01-24T12:44:31.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.507+0000 7f8a99ffb640 1 -- 172.21.15.27:0/3045282779 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8aa4141b60 con 0x7f8aa40b8df0 2024-01-24T12:44:31.511 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 msgr2=0x7f8a88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 0x7f8a88067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0007a70 tx=0x7f8aa0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:31.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 msgr2=0x7f8aa40bb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c500 tx=0x7f8a9400c9c0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 shutdown_connections 2024-01-24T12:44:31.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8a88065a60 0x7f8a88067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8aa4142d80 0x7f8aa413f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8aa40b8df0 0x7f8aa40bb550 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 --2- 172.21.15.27:0/3045282779 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8aa40b8540 0x7f8aa41410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 >> 172.21.15.27:0/3045282779 conn(0x7f8aa406a120 msgr2=0x7f8aa40b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 shutdown_connections 2024-01-24T12:44:31.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.511+0000 7f8aab4e3640 1 -- 172.21.15.27:0/3045282779 wait complete. 2024-01-24T12:44:31.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:31.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 Processor -- start 2024-01-24T12:44:31.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 -- start start 2024-01-24T12:44:31.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8c1c0b8df0 0x7f8c1c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8c1c0b8540 0x7f8c1c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c148a80 con 0x7f8c1c142d80 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0b3890 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c2353c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0b3b70 con 0x7f8c1c0b8540 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c21ad9640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8c1c142d80 0x7f8c1c0b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51408/0 (socket says 172.21.15.27:51408) 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c21ad9640 1 -- 172.21.15.27:0/4194560219 learned_addr learned my addr 172.21.15.27:0/4194560219 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c212d8640 1 --2- 172.21.15.27:0/4194560219 >> v2:172.21.15.27:3300/0 conn(0x7f8c1c0b8df0 0x7f8c1c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c20ad7640 1 --2- 172.21.15.27:0/4194560219 >> v2:172.21.15.124:3300/0 conn(0x7f8c1c0b8540 0x7f8c1c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c212d8640 1 -- 172.21.15.27:0/4194560219 >> v2:172.21.15.124:3300/0 conn(0x7f8c1c0b8540 msgr2=0x7f8c1c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c212d8640 1 --2- 172.21.15.27:0/4194560219 >> v2:172.21.15.124:3300/0 conn(0x7f8c1c0b8540 0x7f8c1c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c212d8640 1 -- 172.21.15.27:0/4194560219 >> v1:172.21.15.27:6789/0 conn(0x7f8c1c142d80 legacy=0x7f8c1c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c212d8640 1 -- 172.21.15.27:0/4194560219 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0b3e50 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.659+0000 7f8c13fff640 1 -- 172.21.15.27:0/4194560219 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654997839 0 0) 0x7f8c1c148a80 con 0x7f8c1c142d80 2024-01-24T12:44:31.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c212d8640 1 --2- 172.21.15.27:0/4194560219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c142840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b4e50 tx=0x7f8c1801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1679ebf162fb2104 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c13fff640 1 -- 172.21.15.27:0/4194560219 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c071930 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c13fff640 1 -- 172.21.15.27:0/4194560219 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c180ab680 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c13fff640 1 -- 172.21.15.27:0/4194560219 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180aba10 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- 172.21.15.27:0/4194560219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8df0 msgr2=0x7f8c1c142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- 172.21.15.27:0/4194560219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c142840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b4e50 tx=0x7f8c1801c460 comp rx=0 tx=0).stop 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- 172.21.15.27:0/4194560219 shutdown_connections 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- 172.21.15.27:0/4194560219 >> v2:172.21.15.124:3300/0 conn(0x7f8c1c0b8540 0x7f8c1c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- 172.21.15.27:0/4194560219 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c142840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- 172.21.15.27:0/4194560219 >> 172.21.15.27:0/4194560219 conn(0x7f8c1c06a120 msgr2=0x7f8c1c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- 172.21.15.27:0/4194560219 shutdown_connections 2024-01-24T12:44:31.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- 172.21.15.27:0/4194560219 wait complete. 2024-01-24T12:44:31.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 Processor -- start 2024-01-24T12:44:31.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- start start 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 0x7f8c1c13f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c144b80 con 0x7f8c1c0b8540 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c144570 con 0x7f8c1c0b8df0 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.663+0000 7f8c2353c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c145aa0 con 0x7f8c1c142d80 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54138/0 (socket says 172.21.15.27:54138) 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 -- 172.21.15.27:0/3527041474 learned_addr learned my addr 172.21.15.27:0/3527041474 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c21ad9640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 0x7f8c1c13f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 -- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 msgr2=0x7f8c1c13f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 0x7f8c1c13f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c20ad7640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 -- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c1c0b8df0 msgr2=0x7f8c1c143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 -- 172.21.15.27:0/3527041474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18009420 con 0x7f8c1c0b8540 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c21ad9640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 0x7f8c1c13f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c212d8640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ad040 tx=0x7f8c1801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180b5810 con 0x7f8c1c0b8540 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c180b5970 con 0x7f8c1c0b8540 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c144810 con 0x7f8c1c0b8540 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180b5d00 con 0x7f8c1c0b8540 2024-01-24T12:44:31.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c140cf0 con 0x7f8c1c0b8540 2024-01-24T12:44:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c04e000 con 0x7f8c1c0b8540 2024-01-24T12:44:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c180b4390 con 0x7f8c1c0b8540 2024-01-24T12:44:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 0x7f8c00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c1811dc40 con 0x7f8c1c0b8540 2024-01-24T12:44:31.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c20ad7640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 0x7f8c00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.667+0000 7f8c20ad7640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 0x7f8c00067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c1423f0 tx=0x7f8c0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.671+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8c180eb7b0 con 0x7f8c1c0b8540 2024-01-24T12:44:31.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.827+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c1c0ba940 con 0x7f8c1c0b8540 2024-01-24T12:44:31.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c11ffb640 1 -- 172.21.15.27:0/3527041474 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c180b5e60 con 0x7f8c1c0b8540 2024-01-24T12:44:31.831 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:31.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 msgr2=0x7f8c00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 0x7f8c00067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c1423f0 tx=0x7f8c0c008040 comp rx=0 tx=0).stop 2024-01-24T12:44:31.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 msgr2=0x7f8c1c145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ad040 tx=0x7f8c1801aca0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 shutdown_connections 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8c00065a60 0x7f8c00067f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8c1c142d80 0x7f8c1c13f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8c1c0b8df0 0x7f8c1c143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 --2- 172.21.15.27:0/3527041474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8c1c0b8540 0x7f8c1c145560 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 >> 172.21.15.27:0/3527041474 conn(0x7f8c1c06a120 msgr2=0x7f8c1c0b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 shutdown_connections 2024-01-24T12:44:31.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.831+0000 7f8c2353c640 1 -- 172.21.15.27:0/3527041474 wait complete. 2024-01-24T12:44:31.850 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:31.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 Processor -- start 2024-01-24T12:44:31.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 -- start start 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8d40b8df0 0x7fd8d4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd8d40b8530 0x7fd8d4152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d406ec30 con 0x7fd8d4070e40 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40b30e0 con 0x7fd8d40b8df0 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8da6a8640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40b3770 con 0x7fd8d40b8530 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8d40b8df0 0x7fd8d4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd8d40b8df0 0x7fd8d4147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54144/0 (socket says 172.21.15.27:54144) 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d37fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd8d4070e40 0x7fd8d4141620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51414/0 (socket says 172.21.15.27:51414) 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 -- 172.21.15.27:0/3975850692 learned_addr learned my addr 172.21.15.27:0/3975850692 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d8c45640 1 --2- 172.21.15.27:0/3975850692 >> v2:172.21.15.124:3300/0 conn(0x7fd8d40b8530 0x7fd8d4152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 -- 172.21.15.27:0/3975850692 >> v2:172.21.15.124:3300/0 conn(0x7fd8d40b8530 msgr2=0x7fd8d4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:31.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 --2- 172.21.15.27:0/3975850692 >> v2:172.21.15.124:3300/0 conn(0x7fd8d40b8530 0x7fd8d4152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 -- 172.21.15.27:0/3975850692 >> v1:172.21.15.27:6789/0 conn(0x7fd8d4070e40 legacy=0x7fd8d4141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d3fff640 1 -- 172.21.15.27:0/3975850692 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4071890 con 0x7fd8d40b8df0 2024-01-24T12:44:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.975+0000 7fd8d2ffd640 1 -- 172.21.15.27:0/3975850692 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181100749 0 0) 0x7fd8d406ec30 con 0x7fd8d4070e40 2024-01-24T12:44:31.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d3fff640 1 --2- 172.21.15.27:0/3975850692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d4147eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b3490 tx=0x7fd8c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6425bd6bc2d8728b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d2ffd640 1 -- 172.21.15.27:0/3975850692 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40aa430 con 0x7fd8d40b8df0 2024-01-24T12:44:31.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d2ffd640 1 -- 172.21.15.27:0/3975850692 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c40aa590 con 0x7fd8d40b8df0 2024-01-24T12:44:31.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d2ffd640 1 -- 172.21.15.27:0/3975850692 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40aa920 con 0x7fd8d40b8df0 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/3975850692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 msgr2=0x7fd8d4147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/3975850692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d4147eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b3490 tx=0x7fd8c401c4d0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/3975850692 shutdown_connections 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/3975850692 >> v2:172.21.15.124:3300/0 conn(0x7fd8d40b8530 0x7fd8d4152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/3975850692 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d4147eb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/3975850692 >> 172.21.15.27:0/3975850692 conn(0x7fd8d406a120 msgr2=0x7fd8d406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/3975850692 shutdown_connections 2024-01-24T12:44:31.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/3975850692 wait complete. 2024-01-24T12:44:31.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 Processor -- start 2024-01-24T12:44:31.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- start start 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8d40b8530 0x7fd8d4137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 0x7fd8d413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4137cc0 con 0x7fd8d40b8df0 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4152140 con 0x7fd8d40b8530 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4152390 con 0x7fd8d413be60 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54148/0 (socket says 172.21.15.27:54148) 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 -- 172.21.15.27:0/226741058 learned_addr learned my addr 172.21.15.27:0/226741058 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d8c45640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 0x7fd8d413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d3fff640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8d40b8530 0x7fd8d4137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 -- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 msgr2=0x7fd8d413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 0x7fd8d413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 -- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8d40b8530 msgr2=0x7fd8d4137780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8d40b8530 0x7fd8d4137780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 -- 172.21.15.27:0/226741058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40094d0 con 0x7fd8d40b8df0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d8c45640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 0x7fd8d413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d37fe640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c520 tx=0x7fd8c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8007560 con 0x7fd8d40b8df0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c80047f0 con 0x7fd8d40b8df0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d4140320 con 0x7fd8d40b8df0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8004ba0 con 0x7fd8d40b8df0 2024-01-24T12:44:31.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.979+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4138500 con 0x7fd8d40b8df0 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d404e000 con 0x7fd8d40b8df0 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8c8004d00 con 0x7fd8d40b8df0 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8d0ff9640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 0x7fd8c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c8082640 con 0x7fd8d40b8df0 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8d3fff640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 0x7fd8c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.983+0000 7fd8d3fff640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 0x7fd8c0067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40ae000 tx=0x7fd8c40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:31.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:31.987+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd8c8050090 con 0x7fd8d40b8df0 2024-01-24T12:44:32.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.143+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8d40bbac0 con 0x7fd8d40b8df0 2024-01-24T12:44:32.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.143+0000 7fd8d0ff9640 1 -- 172.21.15.27:0/226741058 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8c80536b0 con 0x7fd8d40b8df0 2024-01-24T12:44:32.146 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:32.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 msgr2=0x7fd8c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 0x7fd8c0067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40ae000 tx=0x7fd8c40a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 msgr2=0x7fd8d413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c520 tx=0x7fd8c800c9e0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 shutdown_connections 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd8c0065a60 0x7fd8c0067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd8d413be60 0x7fd8d413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd8d40b8df0 0x7fd8d413f8a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 --2- 172.21.15.27:0/226741058 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd8d40b8530 0x7fd8d4137780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 >> 172.21.15.27:0/226741058 conn(0x7fd8d406a120 msgr2=0x7fd8d40b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 shutdown_connections 2024-01-24T12:44:32.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.147+0000 7fd8da6a8640 1 -- 172.21.15.27:0/226741058 wait complete. 2024-01-24T12:44:32.165 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:32.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.283+0000 7fdb79633640 1 Processor -- start 2024-01-24T12:44:32.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.283+0000 7fdb79633640 1 -- start start 2024-01-24T12:44:32.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb79633640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdb740b42d0 0x7fdb74154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb79633640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b3c40 con 0x7fdb74071160 2024-01-24T12:44:32.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb79633640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b4760 con 0x7fdb740b9900 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb79633640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb740b5140 con 0x7fdb740b42d0 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdb74071160 0x7fdb740b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51422/0 (socket says 172.21.15.27:51422) 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 -- 172.21.15.27:0/4036978473 learned_addr learned my addr 172.21.15.27:0/4036978473 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb737fe640 1 --2- 172.21.15.27:0/4036978473 >> v2:172.21.15.124:3300/0 conn(0x7fdb740b42d0 0x7fdb74154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376449506 0 0) 0x7fdb740b3c40 con 0x7fdb74071160 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c003530 con 0x7fdb74071160 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693735784 0 0) 0x7fdb5c003530 con 0x7fdb74071160 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 >> v2:172.21.15.124:3300/0 conn(0x7fdb740b42d0 msgr2=0x7fdb74154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 --2- 172.21.15.27:0/4036978473 >> v2:172.21.15.124:3300/0 conn(0x7fdb740b42d0 0x7fdb74154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 >> v1:172.21.15.124:6789/0 conn(0x7fdb740b9900 legacy=0x7fdb741429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b9d50 con 0x7fdb74071160 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fdb64001680 con 0x7fdb74071160 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 >> v1:172.21.15.27:6789/0 conn(0x7fdb74071160 legacy=0x7fdb740b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 0x7fdb5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c0047d0 0x7fdb5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb5c005190 0x7fdb5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740b5140 con 0x7fdb5c003980 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c130 con 0x7fdb5c005190 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c2f0 con 0x7fdb5c0047d0 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 0x7fdb5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb737fe640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb5c005190 0x7fdb5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb727fc640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c0047d0 0x7fdb5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 -- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c0047d0 msgr2=0x7fdb5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c0047d0 0x7fdb5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 -- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb5c005190 msgr2=0x7fdb5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb5c005190 0x7fdb5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 -- 172.21.15.27:0/4036978473 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c003530 con 0x7fdb5c003980 2024-01-24T12:44:32.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb737fe640 1 -- 172.21.15.27:0/4036978473 reap_dead start 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 0x7fdb5c003da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c240 tx=0x7fdb6401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d52fee6f2a45f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005ae0 con 0x7fdb5c003980 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64005c40 con 0x7fdb5c003980 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.287+0000 7fdb71ffb640 1 -- 172.21.15.27:0/4036978473 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640a58b0 con 0x7fdb5c003980 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 msgr2=0x7fdb5c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 0x7fdb5c003da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c240 tx=0x7fdb6401cbd0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/4036978473 shutdown_connections 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 --2- 172.21.15.27:0/4036978473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb5c003980 0x7fdb5c003da0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/4036978473 >> 172.21.15.27:0/4036978473 conn(0x7fdb740be150 msgr2=0x7fdb740be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/4036978473 shutdown_connections 2024-01-24T12:44:32.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/4036978473 wait complete. 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 Processor -- start 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- start start 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c003980 0x7fdb7414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb74145ab0 0x7fdb74145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74143810 con 0x7fdb74148150 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7414ace0 con 0x7fdb74145ab0 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74148b10 con 0x7fdb5c003980 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54156/0 (socket says 172.21.15.27:54156) 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 -- 172.21.15.27:0/1065884166 learned_addr learned my addr 172.21.15.27:0/1065884166 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb727fc640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb74145ab0 0x7fdb74145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c003980 0x7fdb7414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 -- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c003980 msgr2=0x7fdb7414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c003980 0x7fdb7414a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 -- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb74145ab0 msgr2=0x7fdb74145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb74145ab0 0x7fdb74145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 -- 172.21.15.27:0/1065884166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7414af60 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb737fe640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb740a10d0 tx=0x7fdb6c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00e070 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c011de0 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74144450 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0039a0 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.291+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb741e47a0 con 0x7fdb74148150 2024-01-24T12:44:32.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb74144900 con 0x7fdb74148150 2024-01-24T12:44:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb6c003b00 con 0x7fdb74148150 2024-01-24T12:44:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb5b7fe640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 0x7fdb60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb6c083880 con 0x7fdb74148150 2024-01-24T12:44:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 0x7fdb60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.295+0000 7fdb72ffd640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 0x7fdb60067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb640ab000 tx=0x7fdb640b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.299+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdb74144900 con 0x7fdb74148150 2024-01-24T12:44:32.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.447+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb74144900 con 0x7fdb74148150 2024-01-24T12:44:32.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb5b7fe640 1 -- 172.21.15.27:0/1065884166 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fdb74144900 con 0x7fdb74148150 2024-01-24T12:44:32.452 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:32.452 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 msgr2=0x7fdb60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 0x7fdb60067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb640ab000 tx=0x7fdb640b1040 comp rx=0 tx=0).stop 2024-01-24T12:44:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 msgr2=0x7fdb741485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb740a10d0 tx=0x7fdb6c0115a0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 shutdown_connections 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdb60065a60 0x7fdb60067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb74148150 0x7fdb741485d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdb74145ab0 0x7fdb74145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 --2- 172.21.15.27:0/1065884166 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdb5c003980 0x7fdb7414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 >> 172.21.15.27:0/1065884166 conn(0x7fdb740be150 msgr2=0x7fdb740a2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 shutdown_connections 2024-01-24T12:44:32.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.451+0000 7fdb79633640 1 -- 172.21.15.27:0/1065884166 wait complete. 2024-01-24T12:44:32.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:32.471 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:32.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.595+0000 7ff1641ff640 1 Processor -- start 2024-01-24T12:44:32.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.595+0000 7ff1641ff640 1 -- start start 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff1641ff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff1641ff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff15c0b8540 0x7ff15c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff1641ff640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c148a80 con 0x7ff15c142d80 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff1641ff640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c0b3890 con 0x7ff15c0b8540 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff1641ff640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0b3b70 con 0x7ff15c0b8df0 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff15c0b8540 0x7ff15c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff15c0b8540 0x7ff15c148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54160/0 (socket says 172.21.15.27:54160) 2024-01-24T12:44:32.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 -- 172.21.15.27:0/1930111632 learned_addr learned my addr 172.21.15.27:0/1930111632 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:32.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff161f9b640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 -- 172.21.15.27:0/1930111632 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 msgr2=0x7ff15c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 -- 172.21.15.27:0/1930111632 >> v1:172.21.15.124:6789/0 conn(0x7ff15c142d80 legacy=0x7ff15c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 -- 172.21.15.27:0/1930111632 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c0b3e50 con 0x7ff15c0b8540 2024-01-24T12:44:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff16179a640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c0b8540 0x7ff15c148f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2df0635d4ac4cb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff160f99640 1 -- 172.21.15.27:0/1930111632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c071930 con 0x7ff15c0b8540 2024-01-24T12:44:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff160f99640 1 -- 172.21.15.27:0/1930111632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0aa640 con 0x7ff15c0b8540 2024-01-24T12:44:32.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.599+0000 7ff160f99640 1 -- 172.21.15.27:0/1930111632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0aa9d0 con 0x7ff15c0b8540 2024-01-24T12:44:32.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/1930111632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c0b8540 msgr2=0x7ff15c148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c0b8540 0x7ff15c148f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c01c500 comp rx=0 tx=0).stop 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/1930111632 shutdown_connections 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c0b8540 0x7ff15c148f10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- 172.21.15.27:0/1930111632 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/1930111632 >> 172.21.15.27:0/1930111632 conn(0x7ff15c06a120 msgr2=0x7ff15c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/1930111632 shutdown_connections 2024-01-24T12:44:32.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/1930111632 wait complete. 2024-01-24T12:44:32.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 Processor -- start 2024-01-24T12:44:32.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- start start 2024-01-24T12:44:32.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff15c0b8540 0x7ff15c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.606 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c1e6810 con 0x7ff15c142d80 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c152300 con 0x7ff15c0b8540 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0bcdb0 con 0x7ff15c0b8df0 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54176/0 (socket says 172.21.15.27:54176) 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 -- 172.21.15.27:0/650527437 learned_addr learned my addr 172.21.15.27:0/650527437 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16179a640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff161f9b640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff15c0b8540 0x7ff15c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 -- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 msgr2=0x7ff15c150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 -- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff15c0b8540 msgr2=0x7ff15c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff15c0b8540 0x7ff15c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 -- 172.21.15.27:0/650527437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0094d0 con 0x7ff15c142d80 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff16279c640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff15400be60 tx=0x7ff15400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154014440 con 0x7ff15c142d80 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540145a0 con 0x7ff15c142d80 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c1e6d20 con 0x7ff15c142d80 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154014990 con 0x7ff15c142d80 2024-01-24T12:44:32.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.603+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1e71b0 con 0x7ff15c142d80 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c1e6eb0 con 0x7ff15c142d80 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff15401d3b0 con 0x7ff15c142d80 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff1527fc640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 0x7ff140067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff154083250 con 0x7ff15c142d80 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff161f9b640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 0x7ff140067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.607+0000 7ff161f9b640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 0x7ff140067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff15800b9d0 tx=0x7ff158008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.611+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff154050ca0 con 0x7ff15c142d80 2024-01-24T12:44:32.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff15c04e000 con 0x7ff15c142d80 2024-01-24T12:44:32.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1527fc640 1 -- 172.21.15.27:0/650527437 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1540542c0 con 0x7ff15c142d80 2024-01-24T12:44:32.772 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 msgr2=0x7ff140067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 0x7ff140067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff15800b9d0 tx=0x7ff158008040 comp rx=0 tx=0).stop 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 msgr2=0x7ff15c145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff15400be60 tx=0x7ff15400bf50 comp rx=0 tx=0).stop 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 shutdown_connections 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff140065a90 0x7ff140067f50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff15c142d80 0x7ff15c145710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff15c0b8df0 0x7ff15c150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 --2- 172.21.15.27:0/650527437 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff15c0b8540 0x7ff15c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 >> 172.21.15.27:0/650527437 conn(0x7ff15c06a120 msgr2=0x7ff15c1409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 shutdown_connections 2024-01-24T12:44:32.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.771+0000 7ff1641ff640 1 -- 172.21.15.27:0/650527437 wait complete. 2024-01-24T12:44:32.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:32.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.915+0000 7f38ff726640 1 Processor -- start 2024-01-24T12:44:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.915+0000 7f38ff726640 1 -- start start 2024-01-24T12:44:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38ff726640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f38f80bae50 0x7f38f814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38ff726640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f814b010 0x7f38f80b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38ff726640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f806abb0 con 0x7f38f80ba470 2024-01-24T12:44:32.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38ff726640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f806a910 con 0x7f38f80bae50 2024-01-24T12:44:32.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38ff726640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80bf810 con 0x7f38f814b010 2024-01-24T12:44:32.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fd4c2640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f38f80bae50 0x7f38f814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fccc1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f814b010 0x7f38f80b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fdcc3640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f38f80ba470 0x7f38f814dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:35066/0 (socket says 172.21.15.27:35066) 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fdcc3640 1 -- 172.21.15.27:0/1681731843 learned_addr learned my addr 172.21.15.27:0/1681731843 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fd4c2640 1 -- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f814b010 msgr2=0x7f38f80b99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fd4c2640 1 --2- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f814b010 0x7f38f80b99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fd4c2640 1 -- 172.21.15.27:0/1681731843 >> v1:172.21.15.124:6789/0 conn(0x7f38f80ba470 legacy=0x7f38f814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.919+0000 7f38fd4c2640 1 -- 172.21.15.27:0/1681731843 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80bffd0 con 0x7f38f80bae50 2024-01-24T12:44:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fd4c2640 1 --2- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f814aad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097f0 tx=0x7f38f401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b0c261d090438c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38effff640 1 -- 172.21.15.27:0/1681731843 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ab600 con 0x7f38f80bae50 2024-01-24T12:44:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38effff640 1 -- 172.21.15.27:0/1681731843 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40a7050 con 0x7f38f80bae50 2024-01-24T12:44:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38effff640 1 -- 172.21.15.27:0/1681731843 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ab980 con 0x7f38f80bae50 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 msgr2=0x7f38f814aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f814aad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097f0 tx=0x7f38f401c3f0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1681731843 shutdown_connections 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f814b010 0x7f38f80b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- 172.21.15.27:0/1681731843 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f814aad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1681731843 >> 172.21.15.27:0/1681731843 conn(0x7f38f80c0270 msgr2=0x7f38f80c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1681731843 shutdown_connections 2024-01-24T12:44:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1681731843 wait complete. 2024-01-24T12:44:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 Processor -- start 2024-01-24T12:44:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- start start 2024-01-24T12:44:32.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f80ba470 0x7f38f80be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f80b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80bed90 con 0x7f38f814b010 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80b3d30 con 0x7f38f80bae50 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80b4d70 con 0x7f38f80ba470 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54182/0 (socket says 172.21.15.27:54182) 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 -- 172.21.15.27:0/1688834356 learned_addr learned my addr 172.21.15.27:0/1688834356 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fd4c2640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f80ba470 0x7f38f80be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fccc1640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f80b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 -- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f80ba470 msgr2=0x7f38f80be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f80ba470 0x7f38f80be850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 -- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 msgr2=0x7f38f80b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f80b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 -- 172.21.15.27:0/1688834356 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009420 con 0x7f38f814b010 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38fdcc3640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38f000ca50 tx=0x7f38f000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f000abb0 con 0x7f38f814b010 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f000ad10 con 0x7f38f814b010 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f814a0f0 con 0x7f38f814b010 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0012600 con 0x7f38f814b010 2024-01-24T12:44:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.923+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f80b4930 con 0x7f38f814b010 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f814aca0 con 0x7f38f814b010 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f38f0007070 con 0x7f38f814b010 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38edffb640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 0x7f38dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38f0082f30 con 0x7f38f814b010 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38fd4c2640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 0x7f38dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.927+0000 7f38fd4c2640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 0x7f38dc067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ad000 tx=0x7f38f40a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:32.931+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f38f814aca0 con 0x7f38f814b010 2024-01-24T12:44:33.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.087+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38f814aca0 con 0x7f38f814b010 2024-01-24T12:44:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.087+0000 7f38edffb640 1 -- 172.21.15.27:0/1688834356 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38f814aca0 con 0x7f38f814b010 2024-01-24T12:44:33.089 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:33.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 msgr2=0x7f38dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 0x7f38dc067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ad000 tx=0x7f38f40a4f90 comp rx=0 tx=0).stop 2024-01-24T12:44:33.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 msgr2=0x7f38f80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38f000ca50 tx=0x7f38f000cf10 comp rx=0 tx=0).stop 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 shutdown_connections 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f38dc065a90 0x7f38dc067f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38f814b010 0x7f38f80b43f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f38f80bae50 0x7f38f80b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 --2- 172.21.15.27:0/1688834356 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f38f80ba470 0x7f38f80be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 >> 172.21.15.27:0/1688834356 conn(0x7f38f80c0270 msgr2=0x7f38f80a15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 shutdown_connections 2024-01-24T12:44:33.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.091+0000 7f38ff726640 1 -- 172.21.15.27:0/1688834356 wait complete. 2024-01-24T12:44:33.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:33.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 Processor -- start 2024-01-24T12:44:33.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 -- start start 2024-01-24T12:44:33.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb898154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8980b6af0 con 0x7fb8980717a0 2024-01-24T12:44:33.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8980b7670 con 0x7fb898070e00 2024-01-24T12:44:33.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89f268640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980b61e0 con 0x7fb8981489a0 2024-01-24T12:44:33.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89c803640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb8980717a0 0x7fb8981512f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51428/0 (socket says 172.21.15.27:51428) 2024-01-24T12:44:33.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89c803640 1 -- 172.21.15.27:0/2347655379 learned_addr learned my addr 172.21.15.27:0/2347655379 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:33.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d805640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb898154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992298939 0 0) 0x7fb888001120 con 0x7fb8980717a0 2024-01-24T12:44:33.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb884003530 con 0x7fb8980717a0 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3711735785 0 0) 0x7fb884003530 con 0x7fb8980717a0 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 msgr2=0x7fb898154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb898154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 >> v1:172.21.15.124:6789/0 conn(0x7fb898070e00 legacy=0x7fb8980b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898149870 con 0x7fb8980717a0 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fb888001810 con 0x7fb8980717a0 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 >> v1:172.21.15.27:6789/0 conn(0x7fb8980717a0 legacy=0x7fb8981512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb884003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb8840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb884004d10 0x7fb884005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980b61e0 con 0x7fb8840039b0 2024-01-24T12:44:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88400b990 con 0x7fb884004d10 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88400bb50 con 0x7fb8981489a0 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb884003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89c803640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb8840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d805640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb884004d10 0x7fb884005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 -- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 msgr2=0x7fb8840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8981489a0 0x7fb8840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 -- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb884004d10 msgr2=0x7fb884005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb884004d10 0x7fb884005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.231+0000 7fb89d004640 1 -- 172.21.15.27:0/2347655379 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884003530 con 0x7fb8840039b0 2024-01-24T12:44:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89d004640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb884003d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8940018c0 tx=0x7fb89401eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31e41e5227af64c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a87b0 con 0x7fb8840039b0 2024-01-24T12:44:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940a8930 con 0x7fb8840039b0 2024-01-24T12:44:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb88ffff640 1 -- 172.21.15.27:0/2347655379 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a8ce0 con 0x7fb8840039b0 2024-01-24T12:44:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- 172.21.15.27:0/2347655379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 msgr2=0x7fb884003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 --2- 172.21.15.27:0/2347655379 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb884003d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8940018c0 tx=0x7fb89401eb90 comp rx=0 tx=0).stop 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89d805640 1 -- 172.21.15.27:0/2347655379 reap_dead start 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- 172.21.15.27:0/2347655379 shutdown_connections 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- 172.21.15.27:0/2347655379 >> 172.21.15.27:0/2347655379 conn(0x7fb8980be100 msgr2=0x7fb8980be510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- 172.21.15.27:0/2347655379 shutdown_connections 2024-01-24T12:44:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- 172.21.15.27:0/2347655379 wait complete. 2024-01-24T12:44:33.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 Processor -- start 2024-01-24T12:44:33.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.235+0000 7fb89f268640 1 -- start start 2024-01-24T12:44:33.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb898143be0 0x7fb898144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8980b4390 0x7fb8980b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898144560 con 0x7fb8840039b0 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898145820 con 0x7fb898143be0 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981ddad0 con 0x7fb8980b4390 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54208/0 (socket says 172.21.15.27:54208) 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 -- 172.21.15.27:0/1161761167 learned_addr learned my addr 172.21.15.27:0/1161761167 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89c803640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb898143be0 0x7fb898144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d805640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8980b4390 0x7fb8980b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 -- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8980b4390 msgr2=0x7fb8980b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8980b4390 0x7fb8980b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 -- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb898143be0 msgr2=0x7fb898144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb898143be0 0x7fb898144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 -- 172.21.15.27:0/1161761167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8981de650 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89d004640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8940018c0 tx=0x7fb884005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894005110 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894005270 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8981ddd20 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894006830 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8981de2e0 con 0x7fb8840039b0 2024-01-24T12:44:33.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8981de470 con 0x7fb8840039b0 2024-01-24T12:44:33.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8940b7040 con 0x7fb8840039b0 2024-01-24T12:44:33.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 0x7fb87c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8941203c0 con 0x7fb8840039b0 2024-01-24T12:44:33.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.239+0000 7fb89c803640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 0x7fb87c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.243+0000 7fb89c803640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 0x7fb87c067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb888001060 tx=0x7fb888009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.243+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb8940edd80 con 0x7fb8840039b0 2024-01-24T12:44:33.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.395+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb89804e000 con 0x7fb8840039b0 2024-01-24T12:44:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.395+0000 7fb88dffb640 1 -- 172.21.15.27:0/1161761167 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8940f13a0 con 0x7fb8840039b0 2024-01-24T12:44:33.398 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 msgr2=0x7fb87c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 0x7fb87c067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb888001060 tx=0x7fb888009040 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 msgr2=0x7fb8981452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8940018c0 tx=0x7fb884005800 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 shutdown_connections 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb87c065a60 0x7fb87c067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb8980b4390 0x7fb8980b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb898143be0 0x7fb898144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 --2- 172.21.15.27:0/1161761167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8840039b0 0x7fb8981452e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 >> 172.21.15.27:0/1161761167 conn(0x7fb8980be100 msgr2=0x7fb8981467f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 shutdown_connections 2024-01-24T12:44:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.399+0000 7fb89f268640 1 -- 172.21.15.27:0/1161761167 wait complete. 2024-01-24T12:44:33.415 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:33.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 Processor -- start 2024-01-24T12:44:33.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 -- start start 2024-01-24T12:44:33.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f352014e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f352014e840 0x7f3520155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3520065f50 con 0x7f3520144b60 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3520071000 con 0x7f352014e840 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f3524999640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520065d40 con 0x7f35200658e0 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f352014e840 0x7f3520155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f352014e840 0x7f3520155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54214/0 (socket says 172.21.15.27:54214) 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 -- 172.21.15.27:0/3162303490 learned_addr learned my addr 172.21.15.27:0/3162303490 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351dd9b640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f352014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 -- 172.21.15.27:0/3162303490 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 msgr2=0x7f352014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f352014e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 -- 172.21.15.27:0/3162303490 >> v1:172.21.15.124:6789/0 conn(0x7f3520144b60 legacy=0x7f352006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.539+0000 7f351ed9d640 1 -- 172.21.15.27:0/3162303490 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520071cf0 con 0x7f352014e840 2024-01-24T12:44:33.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351ed9d640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f352014e840 0x7f3520155450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f351801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120dcc624793d025 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351d59a640 1 -- 172.21.15.27:0/3162303490 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180a7070 con 0x7f352014e840 2024-01-24T12:44:33.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351d59a640 1 -- 172.21.15.27:0/3162303490 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35180ab430 con 0x7f352014e840 2024-01-24T12:44:33.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351d59a640 1 -- 172.21.15.27:0/3162303490 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180ab7c0 con 0x7f352014e840 2024-01-24T12:44:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- 172.21.15.27:0/3162303490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f352014e840 msgr2=0x7f3520155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f352014e840 0x7f3520155450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f351801c540 comp rx=0 tx=0).stop 2024-01-24T12:44:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- 172.21.15.27:0/3162303490 shutdown_connections 2024-01-24T12:44:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f352014e840 0x7f3520155450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- 172.21.15.27:0/3162303490 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f352014e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- 172.21.15.27:0/3162303490 >> 172.21.15.27:0/3162303490 conn(0x7f3520069d20 msgr2=0x7f352006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- 172.21.15.27:0/3162303490 shutdown_connections 2024-01-24T12:44:33.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- 172.21.15.27:0/3162303490 wait complete. 2024-01-24T12:44:33.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 Processor -- start 2024-01-24T12:44:33.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- start start 2024-01-24T12:44:33.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f3520151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 0x7f352013b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35201e6760 con 0x7f3520144b60 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352013bdd0 con 0x7f352014e840 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f3524999640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35201550e0 con 0x7f35200658e0 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54226/0 (socket says 172.21.15.27:54226) 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 -- 172.21.15.27:0/2519238990 learned_addr learned my addr 172.21.15.27:0/2519238990 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351e59c640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f3520151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351ed9d640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 0x7f352013b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 -- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 msgr2=0x7f3520151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f3520151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 -- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 msgr2=0x7f352013b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 0x7f352013b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 -- 172.21.15.27:0/2519238990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180094d0 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351ed9d640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 0x7f352013b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.543+0000 7f351dd9b640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f350800d860 tx=0x7f350800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800de50 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800b8d0 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352013e2b0 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800bc80 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352013d6a0 con 0x7f3520144b60 2024-01-24T12:44:33.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352004e000 con 0x7f3520144b60 2024-01-24T12:44:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f350801e460 con 0x7f3520144b60 2024-01-24T12:44:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 0x7f3500067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3508083700 con 0x7f3520144b60 2024-01-24T12:44:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f351e59c640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 0x7f3500067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.547+0000 7f351e59c640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 0x7f3500067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35100012f0 tx=0x7f3510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.551+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3508051150 con 0x7f3520144b60 2024-01-24T12:44:33.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.711+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35200719a0 con 0x7f3520144b60 2024-01-24T12:44:33.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3516ffd640 1 -- 172.21.15.27:0/2519238990 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f3508054770 con 0x7f3520144b60 2024-01-24T12:44:33.716 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:33.716 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:33.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 msgr2=0x7f3500067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 0x7f3500067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35100012f0 tx=0x7f3510009040 comp rx=0 tx=0).stop 2024-01-24T12:44:33.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 msgr2=0x7f35201e6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f350800d860 tx=0x7f350800dd20 comp rx=0 tx=0).stop 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 shutdown_connections 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3500065a60 0x7f3500067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f352014e840 0x7f352013b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3520144b60 0x7f35201e6220 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 --2- 172.21.15.27:0/2519238990 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f35200658e0 0x7f3520151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 >> 172.21.15.27:0/2519238990 conn(0x7f3520069d20 msgr2=0x7f35200b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 shutdown_connections 2024-01-24T12:44:33.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.715+0000 7f3524999640 1 -- 172.21.15.27:0/2519238990 wait complete. 2024-01-24T12:44:33.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:33.736 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:33.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.863+0000 7f07f790e640 1 Processor -- start 2024-01-24T12:44:33.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f790e640 1 -- start start 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f790e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f07f014b7c0 0x7f07f0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f790e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f0070b80 con 0x7f07f00b7ff0 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f790e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00b8c60 con 0x7f07f0141ab0 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f790e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f014ac60 con 0x7f07f014b7c0 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f07f00b7ff0 0x7f07f014b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51440/0 (socket says 172.21.15.27:51440) 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 -- 172.21.15.27:0/2418580670 learned_addr learned my addr 172.21.15.27:0/2418580670 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f5eab640 1 --2- 172.21.15.27:0/2418580670 >> v2:172.21.15.124:3300/0 conn(0x7f07f014b7c0 0x7f07f0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180150879 0 0) 0x7f07f0070b80 con 0x7f07f00b7ff0 2024-01-24T12:44:33.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc005740 con 0x7f07f00b7ff0 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489417823 0 0) 0x7f07dc005740 con 0x7f07f00b7ff0 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 >> v2:172.21.15.124:3300/0 conn(0x7f07f014b7c0 msgr2=0x7f07f0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 --2- 172.21.15.27:0/2418580670 >> v2:172.21.15.124:3300/0 conn(0x7f07f014b7c0 0x7f07f0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 >> v1:172.21.15.124:6789/0 conn(0x7f07f0141ab0 legacy=0x7f07f0070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00b8430 con 0x7f07f00b7ff0 2024-01-24T12:44:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f07e0001680 con 0x7f07f00b7ff0 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 >> v1:172.21.15.27:6789/0 conn(0x7f07f00b7ff0 legacy=0x7f07f014b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc005b90 0x7f07dc005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 0x7f07dc006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc007260 0x7f07dc00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc00e190 con 0x7f07dc006590 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc00e300 con 0x7f07dc005b90 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc00e4c0 con 0x7f07dc007260 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 0x7f07dc006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f56aa640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc005b90 0x7f07dc005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f5eab640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc007260 0x7f07dc00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 -- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc007260 msgr2=0x7f07dc00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc007260 0x7f07dc00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 -- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc005b90 msgr2=0x7f07dc005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc005b90 0x7f07dc005f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f4ea9640 1 -- 172.21.15.27:0/2418580670 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc005740 con 0x7f07dc006590 2024-01-24T12:44:33.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f56aa640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc005b90 0x7f07dc005f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:33.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f5eab640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07dc007260 0x7f07dc00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:33.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.867+0000 7f07f5eab640 1 -- 172.21.15.27:0/2418580670 reap_dead start 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 0x7f07dc006a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c160 tx=0x7f07e001cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e733c0b250b59d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0005ae0 con 0x7f07dc006590 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0005c60 con 0x7f07dc006590 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07e7fff640 1 -- 172.21.15.27:0/2418580670 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e00072b0 con 0x7f07dc006590 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 msgr2=0x7f07dc006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 0x7f07dc006a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07e000c160 tx=0x7f07e001cac0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- 172.21.15.27:0/2418580670 shutdown_connections 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 --2- 172.21.15.27:0/2418580670 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07dc006590 0x7f07dc006a60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- 172.21.15.27:0/2418580670 >> 172.21.15.27:0/2418580670 conn(0x7f07f006a120 msgr2=0x7f07f006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:33.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- 172.21.15.27:0/2418580670 shutdown_connections 2024-01-24T12:44:33.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- 172.21.15.27:0/2418580670 wait complete. 2024-01-24T12:44:33.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 Processor -- start 2024-01-24T12:44:33.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- start start 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc006590 0x7f07f01e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 0x7f07f0142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01e2ab0 con 0x7f07f0142b50 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0142fd0 con 0x7f07dc006590 2024-01-24T12:44:33.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f790e640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0144540 con 0x7f07f01440e0 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54252/0 (socket says 172.21.15.27:54252) 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 -- 172.21.15.27:0/3340694236 learned_addr learned my addr 172.21.15.27:0/3340694236 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f56aa640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc006590 0x7f07f01e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 0x7f07f0142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 -- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 msgr2=0x7f07f0142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 0x7f07f0142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 -- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc006590 msgr2=0x7f07f01e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc006590 0x7f07f01e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 -- 172.21.15.27:0/3340694236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0143840 con 0x7f07f0142b50 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f4ea9640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 0x7f07f0142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.871+0000 7f07f5eab640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07f00b64e0 tx=0x7f07e8010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800e8a0 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800ea00 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f01e2180 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800edb0 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f01e2740 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f01e2900 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07e8020410 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 0x7f07d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07e8082a50 con 0x7f07f0142b50 2024-01-24T12:44:33.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07f56aa640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 0x7f07d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:33.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.875+0000 7f07f56aa640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 0x7f07d4067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0012f0 tx=0x7f07ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:33.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:33.879+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f07e80504a0 con 0x7f07f0142b50 2024-01-24T12:44:34.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07f01423a0 con 0x7f07f0142b50 2024-01-24T12:44:34.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07e5ffb640 1 -- 172.21.15.27:0/3340694236 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07e8053ac0 con 0x7f07f0142b50 2024-01-24T12:44:34.036 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 msgr2=0x7f07d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 0x7f07d4067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0012f0 tx=0x7f07ec009040 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 msgr2=0x7f07f0138020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.035+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07f00b64e0 tx=0x7f07e8010c20 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 shutdown_connections 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f07d4065a60 0x7f07d4067f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07f0142b50 0x7f07f0138020 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f07f01440e0 0x7f07f0142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 --2- 172.21.15.27:0/3340694236 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f07dc006590 0x7f07f01e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 >> 172.21.15.27:0/3340694236 conn(0x7f07f006a120 msgr2=0x7f07f013ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 shutdown_connections 2024-01-24T12:44:34.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.039+0000 7f07f790e640 1 -- 172.21.15.27:0/3340694236 wait complete. 2024-01-24T12:44:34.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:34.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 Processor -- start 2024-01-24T12:44:34.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 -- start start 2024-01-24T12:44:34.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f18ec0b8b40 0x7f18ec0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18ec144a80 0x7f18ec14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec0b6e80 con 0x7f18ec144f10 2024-01-24T12:44:34.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0b7160 con 0x7f18ec144a80 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f362a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0bc6c0 con 0x7f18ec0b8b40 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18ec144a80 0x7f18ec14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f18ec144a80 0x7f18ec14ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54266/0 (socket says 172.21.15.27:54266) 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 -- 172.21.15.27:0/4273617402 learned_addr learned my addr 172.21.15.27:0/4273617402 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f13c6640 1 --2- 172.21.15.27:0/4273617402 >> v2:172.21.15.124:3300/0 conn(0x7f18ec0b8b40 0x7f18ec0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 -- 172.21.15.27:0/4273617402 >> v2:172.21.15.124:3300/0 conn(0x7f18ec0b8b40 msgr2=0x7f18ec0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 --2- 172.21.15.27:0/4273617402 >> v2:172.21.15.124:3300/0 conn(0x7f18ec0b8b40 0x7f18ec0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 -- 172.21.15.27:0/4273617402 >> v1:172.21.15.124:6789/0 conn(0x7f18ec144f10 legacy=0x7f18ec14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.179+0000 7f18f0bc5640 1 -- 172.21.15.27:0/4273617402 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec0bc9a0 con 0x7f18ec144a80 2024-01-24T12:44:34.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f0bc5640 1 --2- 172.21.15.27:0/4273617402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144a80 0x7f18ec14ac60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ba8f0 tx=0x7f18dc01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68692b757fa563cf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18e3fff640 1 -- 172.21.15.27:0/4273617402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0a89b0 con 0x7f18ec144a80 2024-01-24T12:44:34.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18e3fff640 1 -- 172.21.15.27:0/4273617402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0a8b10 con 0x7f18ec144a80 2024-01-24T12:44:34.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18e3fff640 1 -- 172.21.15.27:0/4273617402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0a8ea0 con 0x7f18ec144a80 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- 172.21.15.27:0/4273617402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144a80 msgr2=0x7f18ec14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- 172.21.15.27:0/4273617402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144a80 0x7f18ec14ac60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ba8f0 tx=0x7f18dc01ecb0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- 172.21.15.27:0/4273617402 shutdown_connections 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- 172.21.15.27:0/4273617402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144a80 0x7f18ec14ac60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- 172.21.15.27:0/4273617402 >> v2:172.21.15.124:3300/0 conn(0x7f18ec0b8b40 0x7f18ec0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- 172.21.15.27:0/4273617402 >> 172.21.15.27:0/4273617402 conn(0x7f18ec0c02f0 msgr2=0x7f18ec0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- 172.21.15.27:0/4273617402 shutdown_connections 2024-01-24T12:44:34.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- 172.21.15.27:0/4273617402 wait complete. 2024-01-24T12:44:34.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 Processor -- start 2024-01-24T12:44:34.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- start start 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f18ec0b8b40 0x7f18ec146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 0x7f18ec1d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1d4490 con 0x7f18ec144f10 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1d3310 con 0x7f18ec144a80 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f362a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1d1630 con 0x7f18ec0b8b40 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f1bc7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f1bc7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54282/0 (socket says 172.21.15.27:54282) 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.183+0000 7f18f1bc7640 1 -- 172.21.15.27:0/1475908781 learned_addr learned my addr 172.21.15.27:0/1475908781 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f13c6640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f18ec0b8b40 0x7f18ec146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f0bc5640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 0x7f18ec1d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 -- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f18ec0b8b40 msgr2=0x7f18ec146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f18ec0b8b40 0x7f18ec146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 -- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 msgr2=0x7f18ec1d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 0x7f18ec1d1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 -- 172.21.15.27:0/1475908781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc0094d0 con 0x7f18ec144f10 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f0bc5640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 0x7f18ec1d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f1bc7640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b9e0 tx=0x7f18e400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4003b80 con 0x7f18ec144f10 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4003ce0 con 0x7f18ec144f10 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec1d1910 con 0x7f18ec144f10 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400cae0 con 0x7f18ec144f10 2024-01-24T12:44:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec0a5b40 con 0x7f18ec144f10 2024-01-24T12:44:34.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec1d1b50 con 0x7f18ec144f10 2024-01-24T12:44:34.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f18e400cc40 con 0x7f18ec144f10 2024-01-24T12:44:34.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 0x7f18d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e4082ef0 con 0x7f18ec144f10 2024-01-24T12:44:34.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f13c6640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 0x7f18d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.187+0000 7f18f13c6640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 0x7f18d0067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009790 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.191+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f18ec1d1b50 con 0x7f18ec144f10 2024-01-24T12:44:34.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.343+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18ec1d1b50 con 0x7f18ec144f10 2024-01-24T12:44:34.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.343+0000 7f18e1ffb640 1 -- 172.21.15.27:0/1475908781 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18ec1d1b50 con 0x7f18ec144f10 2024-01-24T12:44:34.346 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:34.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 msgr2=0x7f18d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 0x7f18d0067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009790 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 msgr2=0x7f18ec1d3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b9e0 tx=0x7f18e400bea0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 shutdown_connections 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f18d0065a60 0x7f18d0067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f18ec144f10 0x7f18ec1d3f50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f18ec144a80 0x7f18ec1d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 --2- 172.21.15.27:0/1475908781 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f18ec0b8b40 0x7f18ec146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 >> 172.21.15.27:0/1475908781 conn(0x7f18ec0c02f0 msgr2=0x7f18ec1d6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 shutdown_connections 2024-01-24T12:44:34.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.347+0000 7f18f362a640 1 -- 172.21.15.27:0/1475908781 wait complete. 2024-01-24T12:44:34.365 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.487+0000 7f42e60d2640 1 Processor -- start 2024-01-24T12:44:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.487+0000 7f42e60d2640 1 -- start start 2024-01-24T12:44:34.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42e60d2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42e0147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42e60d2640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e006ec30 con 0x7f42e00b8530 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42e60d2640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e0071890 con 0x7f42e0070e40 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42e60d2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00b30e0 con 0x7f42e00b8df0 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f42e00b8530 0x7f42e0152000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51454/0 (socket says 172.21.15.27:51454) 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 -- 172.21.15.27:0/2421559556 learned_addr learned my addr 172.21.15.27:0/2421559556 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42df7fe640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42e0147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002972807 0 0) 0x7f42e006ec30 con 0x7f42e00b8530 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003530 con 0x7f42e00b8530 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485074061 0 0) 0x7f42cc003530 con 0x7f42e00b8530 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 msgr2=0x7f42e0147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42e0147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 >> v1:172.21.15.124:6789/0 conn(0x7f42e0070e40 legacy=0x7f42e0141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00712d0 con 0x7f42e00b8530 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f42d8001680 con 0x7f42e00b8530 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 >> v1:172.21.15.27:6789/0 conn(0x7f42e00b8530 legacy=0x7f42e0152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003f30 0x7f42cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42cc004d10 0x7f42cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00b30e0 con 0x7f42cc004d10 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00ba70 con 0x7f42cc003f30 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00de40 con 0x7f42e00b8df0 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42cc004d10 0x7f42cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42deffd640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003f30 0x7f42cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42df7fe640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 -- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 msgr2=0x7f42cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42e00b8df0 0x7f42cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 -- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003f30 msgr2=0x7f42cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42cc003f30 0x7f42cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.491+0000 7f42dffff640 1 -- 172.21.15.27:0/2421559556 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc003530 con 0x7f42cc004d10 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42dffff640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42cc004d10 0x7f42cc005190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c240 tx=0x7f42d801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db53f10f5aba6b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80a5b40 con 0x7f42cc004d10 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d80a5cc0 con 0x7f42cc004d10 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42de7fc640 1 -- 172.21.15.27:0/2421559556 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8005b20 con 0x7f42cc004d10 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/2421559556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42cc004d10 msgr2=0x7f42cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 --2- 172.21.15.27:0/2421559556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42cc004d10 0x7f42cc005190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c240 tx=0x7f42d801cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42dffff640 1 -- 172.21.15.27:0/2421559556 reap_dead start 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/2421559556 shutdown_connections 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/2421559556 >> 172.21.15.27:0/2421559556 conn(0x7f42e006a120 msgr2=0x7f42e006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/2421559556 shutdown_connections 2024-01-24T12:44:34.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/2421559556 wait complete. 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 Processor -- start 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- start start 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 0x7f42e01488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42e0149d90 0x7f42e01455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e014aef0 con 0x7f42e00b55c0 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0148e00 con 0x7f42e0149d90 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01493c0 con 0x7f42cc004d10 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54308/0 (socket says 172.21.15.27:54308) 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 -- 172.21.15.27:0/4230088352 learned_addr learned my addr 172.21.15.27:0/4230088352 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:34.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42df7fe640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 0x7f42e01488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 -- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 msgr2=0x7f42e01488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 0x7f42e01488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 -- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42e0149d90 msgr2=0x7f42e01455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42e0149d90 0x7f42e01455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 -- 172.21.15.27:0/4230088352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e01e2b30 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42df7fe640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 0x7f42e01488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42deffd640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42c800fbc0 tx=0x7f42c800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800fec0 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800db50 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e00b5a20 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800dee0 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.495+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e0146d50 con 0x7f42e00b55c0 2024-01-24T12:44:34.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e004e000 con 0x7f42e00b55c0 2024-01-24T12:44:34.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f42c8003980 con 0x7f42e00b55c0 2024-01-24T12:44:34.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42d7fff640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 0x7f42c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42c8083330 con 0x7f42e00b55c0 2024-01-24T12:44:34.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42df7fe640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 0x7f42c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.499+0000 7f42df7fe640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 0x7f42c0067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ad0 tx=0x7f42d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.503+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f42c8050d80 con 0x7f42e00b55c0 2024-01-24T12:44:34.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.655+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42e0149500 con 0x7f42e00b55c0 2024-01-24T12:44:34.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42d7fff640 1 -- 172.21.15.27:0/4230088352 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42c80543a0 con 0x7f42e00b55c0 2024-01-24T12:44:34.659 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:34.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 msgr2=0x7f42c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 0x7f42c0067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ad0 tx=0x7f42d0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 msgr2=0x7f42e0149850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42c800fbc0 tx=0x7f42c800d520 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 shutdown_connections 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f42c0065a60 0x7f42c0067f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f42e0149d90 0x7f42e01455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42e00b55c0 0x7f42e0149850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 --2- 172.21.15.27:0/4230088352 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f42cc004d10 0x7f42e01488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 >> 172.21.15.27:0/4230088352 conn(0x7f42e006a120 msgr2=0x7f42e013f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 shutdown_connections 2024-01-24T12:44:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.659+0000 7f42e60d2640 1 -- 172.21.15.27:0/4230088352 wait complete. 2024-01-24T12:44:34.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:34.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 Processor -- start 2024-01-24T12:44:34.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 -- start start 2024-01-24T12:44:34.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11180b5e70 0x7f11180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f111806d060 0x7f111806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1118070190 con 0x7f1118146aa0 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111806f920 con 0x7f11180b5e70 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f112046e640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111806f100 con 0x7f111806d060 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11180b5e70 0x7f11180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f11180b5e70 0x7f11180b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54310/0 (socket says 172.21.15.27:54310) 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 -- 172.21.15.27:0/435790209 learned_addr learned my addr 172.21.15.27:0/435790209 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111ea0b640 1 --2- 172.21.15.27:0/435790209 >> v2:172.21.15.124:3300/0 conn(0x7f111806d060 0x7f111806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 -- 172.21.15.27:0/435790209 >> v2:172.21.15.124:3300/0 conn(0x7f111806d060 msgr2=0x7f111806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 --2- 172.21.15.27:0/435790209 >> v2:172.21.15.124:3300/0 conn(0x7f111806d060 0x7f111806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 -- 172.21.15.27:0/435790209 >> v1:172.21.15.124:6789/0 conn(0x7f1118146aa0 legacy=0x7f1118070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 -- 172.21.15.27:0/435790209 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111806fb40 con 0x7f11180b5e70 2024-01-24T12:44:34.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.795+0000 7f111e20a640 1 --2- 172.21.15.27:0/435790209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180b2d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f11180b2750 tx=0x7f111401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f973a17dc713fa6f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111d208640 1 -- 172.21.15.27:0/435790209 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11140ab600 con 0x7f11180b5e70 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111d208640 1 -- 172.21.15.27:0/435790209 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11140a7050 con 0x7f11180b5e70 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111d208640 1 -- 172.21.15.27:0/435790209 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11140ab980 con 0x7f11180b5e70 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/435790209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 msgr2=0x7f11180b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- 172.21.15.27:0/435790209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180b2d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f11180b2750 tx=0x7f111401c430 comp rx=0 tx=0).stop 2024-01-24T12:44:34.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/435790209 shutdown_connections 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- 172.21.15.27:0/435790209 >> v2:172.21.15.124:3300/0 conn(0x7f111806d060 0x7f111806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- 172.21.15.27:0/435790209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180b2d20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/435790209 >> 172.21.15.27:0/435790209 conn(0x7f1118069ef0 msgr2=0x7f111806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/435790209 shutdown_connections 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/435790209 wait complete. 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 Processor -- start 2024-01-24T12:44:34.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- start start 2024-01-24T12:44:34.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 0x7f1118134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 0x7f11181e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181349a0 con 0x7f11180b5e70 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1118136610 con 0x7f1118146aa0 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11181362e0 con 0x7f111806d060 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54322/0 (socket says 172.21.15.27:54322) 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 -- 172.21.15.27:0/3704049918 learned_addr learned my addr 172.21.15.27:0/3704049918 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111ea0b640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 0x7f11181e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111e20a640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 0x7f1118134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 -- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 msgr2=0x7f1118134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 0x7f1118134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 -- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 msgr2=0x7f11181e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 0x7f11181e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 -- 172.21.15.27:0/3704049918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140094d0 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111e20a640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 0x7f1118134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111ea0b640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 0x7f11181e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f111da09640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f110800b440 tx=0x7f110800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011890 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11080119f0 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180bb180 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011da0 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.799+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11180bae90 con 0x7f11180b5e70 2024-01-24T12:44:34.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180bbbf0 con 0x7f11180b5e70 2024-01-24T12:44:34.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f110801a400 con 0x7f11180b5e70 2024-01-24T12:44:34.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f110effd640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 0x7f10fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:34.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11080831b0 con 0x7f11180b5e70 2024-01-24T12:44:34.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f111e20a640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 0x7f10fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:34.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.803+0000 7f111e20a640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 0x7f10fc067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11140ad000 tx=0x7f1114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:34.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.807+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1108050c00 con 0x7f11180b5e70 2024-01-24T12:44:34.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.959+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f111804e000 con 0x7f11180b5e70 2024-01-24T12:44:34.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f110effd640 1 -- 172.21.15.27:0/3704049918 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f1108054220 con 0x7f11180b5e70 2024-01-24T12:44:34.963 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:34.964 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:34.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 msgr2=0x7f10fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 0x7f10fc067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11140ad000 tx=0x7f1114008040 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 msgr2=0x7f11180ba950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f110800b440 tx=0x7f110800b900 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 shutdown_connections 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f10fc065a60 0x7f10fc067f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1118146aa0 0x7f11181e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f11180b5e70 0x7f11180ba950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 --2- 172.21.15.27:0/3704049918 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f111806d060 0x7f1118134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 >> 172.21.15.27:0/3704049918 conn(0x7f1118069ef0 msgr2=0x7f11180b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 shutdown_connections 2024-01-24T12:44:34.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:34.963+0000 7f112046e640 1 -- 172.21.15.27:0/3704049918 wait complete. 2024-01-24T12:44:34.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:34.982 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:35.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 Processor -- start 2024-01-24T12:44:35.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 -- start start 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f039c06af90 0x7f039c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f039c06f520 0x7f039c070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c0706a0 0x7f039c147c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0b8170 con 0x7f039c06f520 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0b0020 con 0x7f039c06af90 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f03a098a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0afb60 con 0x7f039c0706a0 2024-01-24T12:44:35.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f039c06f520 0x7f039c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f039c06f520 0x7f039c070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54338/0 (socket says 172.21.15.27:54338) 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 -- 172.21.15.27:0/3345793294 learned_addr learned my addr 172.21.15.27:0/3345793294 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f039ad9d640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c0706a0 0x7f039c147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f039a59c640 1 --2- 172.21.15.27:0/3345793294 >> v2:172.21.15.124:3300/0 conn(0x7f039c06af90 0x7f039c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 -- 172.21.15.27:0/3345793294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c0706a0 msgr2=0x7f039c147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c0706a0 0x7f039c147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 -- 172.21.15.27:0/3345793294 >> v2:172.21.15.124:3300/0 conn(0x7f039c06af90 msgr2=0x7f039c071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:35.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 --2- 172.21.15.27:0/3345793294 >> v2:172.21.15.124:3300/0 conn(0x7f039c06af90 0x7f039c071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.095+0000 7f0399d9b640 1 -- 172.21.15.27:0/3345793294 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0b8350 con 0x7f039c06f520 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f0399d9b640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c06f520 0x7f039c070160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f039c06bd90 tx=0x7f038c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d5c48f27625536 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039959a640 1 -- 172.21.15.27:0/3345793294 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0ac630 con 0x7f039c06f520 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039959a640 1 -- 172.21.15.27:0/3345793294 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c0ac790 con 0x7f039c06f520 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039959a640 1 -- 172.21.15.27:0/3345793294 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0acb20 con 0x7f039c06f520 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/3345793294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c06f520 msgr2=0x7f039c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c06f520 0x7f039c070160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f039c06bd90 tx=0x7f038c01c500 comp rx=0 tx=0).stop 2024-01-24T12:44:35.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/3345793294 shutdown_connections 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c0706a0 0x7f039c147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- 172.21.15.27:0/3345793294 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c06f520 0x7f039c070160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- 172.21.15.27:0/3345793294 >> v2:172.21.15.124:3300/0 conn(0x7f039c06af90 0x7f039c071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/3345793294 >> 172.21.15.27:0/3345793294 conn(0x7f039c0b9140 msgr2=0x7f039c0b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/3345793294 shutdown_connections 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/3345793294 wait complete. 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 Processor -- start 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- start start 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 0x7f039c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c06f520 0x7f039c0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14db50 con 0x7f039c0706a0 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c14a950 con 0x7f039c06af90 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0b2440 con 0x7f039c06f520 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54350/0 (socket says 172.21.15.27:54350) 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 -- 172.21.15.27:0/1334906499 learned_addr learned my addr 172.21.15.27:0/1334906499 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039a59c640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 0x7f039c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f0399d9b640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c06f520 0x7f039c0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 -- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c06f520 msgr2=0x7f039c0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c06f520 0x7f039c0b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 -- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 msgr2=0x7f039c14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 0x7f039c14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 -- 172.21.15.27:0/1334906499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0094d0 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039a59c640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 0x7f039c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f039ad9d640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0394007e60 tx=0x7f039400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394014420 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940145a0 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c149d20 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394014950 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.099+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c0b20c0 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c065e60 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0394014ab0 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f038affd640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 0x7f037c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0394083960 con 0x7f039c0706a0 2024-01-24T12:44:35.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f039a59c640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 0x7f037c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.103+0000 7f039a59c640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 0x7f037c067f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0390009840 tx=0x7f0390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.107+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f039c065e60 con 0x7f039c0706a0 2024-01-24T12:44:35.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.263+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f039c14aac0 con 0x7f039c0706a0 2024-01-24T12:44:35.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.263+0000 7f038affd640 1 -- 172.21.15.27:0/1334906499 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f039c14aac0 con 0x7f039c0706a0 2024-01-24T12:44:35.266 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 msgr2=0x7f037c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 0x7f037c067f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0390009840 tx=0x7f0390008040 comp rx=0 tx=0).stop 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 msgr2=0x7f039c14ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0394007e60 tx=0x7f039400e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 shutdown_connections 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f037c065a90 0x7f037c067f50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f039c0706a0 0x7f039c14ada0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f039c06f520 0x7f039c0b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 --2- 172.21.15.27:0/1334906499 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f039c06af90 0x7f039c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 >> 172.21.15.27:0/1334906499 conn(0x7f039c0b9140 msgr2=0x7f039c0ba650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 shutdown_connections 2024-01-24T12:44:35.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.267+0000 7f03a098a640 1 -- 172.21.15.27:0/1334906499 wait complete. 2024-01-24T12:44:35.285 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:35.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.399+0000 7f775394f640 1 Processor -- start 2024-01-24T12:44:35.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f775394f640 1 -- start start 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f775394f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f774c1489a0 0x7f774c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f775394f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0b6af0 con 0x7f774c070e00 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f775394f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0b7670 con 0x7f774c0717a0 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f775394f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0b61e0 con 0x7f774c1489a0 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f77516eb640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f774c070e00 0x7f774c0b7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51464/0 (socket says 172.21.15.27:51464) 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f77516eb640 1 -- 172.21.15.27:0/3506024996 learned_addr learned my addr 172.21.15.27:0/3506024996 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7751eec640 1 --2- 172.21.15.27:0/3506024996 >> v2:172.21.15.27:3300/0 conn(0x7f774c1489a0 0x7f774c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7751eec640 1 -- 172.21.15.27:0/3506024996 >> v1:172.21.15.124:6789/0 conn(0x7f774c0717a0 legacy=0x7f774c1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:35.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7751eec640 1 -- 172.21.15.27:0/3506024996 >> v1:172.21.15.27:6789/0 conn(0x7f774c070e00 legacy=0x7f774c0b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7743fff640 1 -- 172.21.15.27:0/3506024996 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953962323 0 0) 0x7f773c0012a0 con 0x7f774c070e00 2024-01-24T12:44:35.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7751eec640 1 -- 172.21.15.27:0/3506024996 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c149870 con 0x7f774c1489a0 2024-01-24T12:44:35.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7751eec640 1 --2- 172.21.15.27:0/3506024996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c154a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7744009d90 tx=0x7f774401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034714505227300 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7743fff640 1 -- 172.21.15.27:0/3506024996 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440af600 con 0x7f774c1489a0 2024-01-24T12:44:35.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7743fff640 1 -- 172.21.15.27:0/3506024996 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440ab050 con 0x7f774c1489a0 2024-01-24T12:44:35.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.403+0000 7f7743fff640 1 -- 172.21.15.27:0/3506024996 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440af980 con 0x7f774c1489a0 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3506024996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 msgr2=0x7f774c154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 --2- 172.21.15.27:0/3506024996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c154a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7744009d90 tx=0x7f774401f100 comp rx=0 tx=0).stop 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3506024996 shutdown_connections 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 --2- 172.21.15.27:0/3506024996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c154a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3506024996 >> 172.21.15.27:0/3506024996 conn(0x7f774c0be100 msgr2=0x7f774c0be510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3506024996 shutdown_connections 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3506024996 wait complete. 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 Processor -- start 2024-01-24T12:44:35.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- start start 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f774c070e00 0x7f774c1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f774c0717a0 0x7f774c143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c14cbb0 con 0x7f774c1489a0 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c14c230 con 0x7f774c070e00 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c143b90 con 0x7f774c0717a0 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54364/0 (socket says 172.21.15.27:54364) 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 -- 172.21.15.27:0/3038177280 learned_addr learned my addr 172.21.15.27:0/3038177280 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 -- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f774c0717a0 msgr2=0x7f774c143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f774c0717a0 0x7f774c143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 -- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f774c070e00 msgr2=0x7f774c1460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f774c070e00 0x7f774c1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 -- 172.21.15.27:0/3038177280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744009a70 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7751eec640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f774401cd30 tx=0x7f774401bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440ba480 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440ba5e0 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c14c4d0 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77440ba950 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c14c7b0 con 0x7f774c1489a0 2024-01-24T12:44:35.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.407+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c04e000 con 0x7f774c1489a0 2024-01-24T12:44:35.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.411+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77440b6040 con 0x7f774c1489a0 2024-01-24T12:44:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.411+0000 7f7741ffb640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 0x7f7730067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.411+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7744121b90 con 0x7f774c1489a0 2024-01-24T12:44:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.411+0000 7f77516eb640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 0x7f7730067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.411+0000 7f77516eb640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 0x7f7730067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f773c0016e0 tx=0x7f773c001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.415+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f77440ef5e0 con 0x7f774c1489a0 2024-01-24T12:44:35.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f774c1e16d0 con 0x7f774c1489a0 2024-01-24T12:44:35.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f7741ffb640 1 -- 172.21.15.27:0/3038177280 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77440f2c00 con 0x7f774c1489a0 2024-01-24T12:44:35.564 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 msgr2=0x7f7730067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 0x7f7730067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f773c0016e0 tx=0x7f773c001360 comp rx=0 tx=0).stop 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 msgr2=0x7f774c1e1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f774401cd30 tx=0x7f774401bea0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 shutdown_connections 2024-01-24T12:44:35.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7730065a60 0x7f7730067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f774c1489a0 0x7f774c1e1a20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f774c0717a0 0x7f774c143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 --2- 172.21.15.27:0/3038177280 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f774c070e00 0x7f774c1460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 >> 172.21.15.27:0/3038177280 conn(0x7f774c0be100 msgr2=0x7f774c0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 shutdown_connections 2024-01-24T12:44:35.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.563+0000 7f775394f640 1 -- 172.21.15.27:0/3038177280 wait complete. 2024-01-24T12:44:35.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:35.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.691+0000 7f172e066640 1 Processor -- start 2024-01-24T12:44:35.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.691+0000 7f172e066640 1 -- start start 2024-01-24T12:44:35.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f172e066640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f17280709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f172e066640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1728144100 0x7f17281445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f172e066640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728070ef0 con 0x7f172806fc30 2024-01-24T12:44:35.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f172e066640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1728071640 con 0x7f1728144100 2024-01-24T12:44:35.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f172e066640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172806ecc0 con 0x7f1728147bc0 2024-01-24T12:44:35.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17277fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f172806fc30 0x7f17281474b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51480/0 (socket says 172.21.15.27:51480) 2024-01-24T12:44:35.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17277fe640 1 -- 172.21.15.27:0/1949241285 learned_addr learned my addr 172.21.15.27:0/1949241285 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 --2- 172.21.15.27:0/1949241285 >> v2:172.21.15.27:3300/0 conn(0x7f1728144100 0x7f17281445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1726ffd640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f17280709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17267fc640 1 -- 172.21.15.27:0/1949241285 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580496751 0 0) 0x7f1718001120 con 0x7f172806fc30 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 -- 172.21.15.27:0/1949241285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 msgr2=0x7f17280709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f17280709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 -- 172.21.15.27:0/1949241285 >> v1:172.21.15.27:6789/0 conn(0x7f172806fc30 legacy=0x7f17281474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 -- 172.21.15.27:0/1949241285 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172806ef30 con 0x7f1728144100 2024-01-24T12:44:35.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f1727fff640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1728144100 0x7f17281445b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f172000aea0 tx=0x7f172001da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cace8c725508fa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17267fc640 1 -- 172.21.15.27:0/1949241285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000a2d0 con 0x7f1728144100 2024-01-24T12:44:35.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17267fc640 1 -- 172.21.15.27:0/1949241285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17200a6860 con 0x7f1728144100 2024-01-24T12:44:35.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.695+0000 7f17267fc640 1 -- 172.21.15.27:0/1949241285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200a6bf0 con 0x7f1728144100 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/1949241285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1728144100 msgr2=0x7f17281445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1728144100 0x7f17281445b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f172000aea0 tx=0x7f172001da20 comp rx=0 tx=0).stop 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/1949241285 shutdown_connections 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1728144100 0x7f17281445b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- 172.21.15.27:0/1949241285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f17280709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/1949241285 >> 172.21.15.27:0/1949241285 conn(0x7f172806a120 msgr2=0x7f172806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/1949241285 shutdown_connections 2024-01-24T12:44:35.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/1949241285 wait complete. 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 Processor -- start 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- start start 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 0x7f17280bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f172813f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281409b0 con 0x7f172806fc30 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b9ea0 con 0x7f1728144100 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280bc780 con 0x7f1728147bc0 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54378/0 (socket says 172.21.15.27:54378) 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 -- 172.21.15.27:0/4030025891 learned_addr learned my addr 172.21.15.27:0/4030025891 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f1727fff640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f172813f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f1726ffd640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 0x7f17280bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 -- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 msgr2=0x7f172813f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f172813f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 -- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 msgr2=0x7f17280bae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 0x7f17280bae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 -- 172.21.15.27:0/4030025891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172000ab80 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f1726ffd640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 0x7f17280bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f17277fe640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7b0 tx=0x7f171800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180072d0 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718007450 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280baa90 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180047f0 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.699+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1728141040 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17280baca0 con 0x7f172806fc30 2024-01-24T12:44:35.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1718004950 con 0x7f172806fc30 2024-01-24T12:44:35.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f170ffff640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 0x7f1714067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:35.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17180825c0 con 0x7f172806fc30 2024-01-24T12:44:35.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f1726ffd640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 0x7f1714067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:35.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.703+0000 7f1726ffd640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 0x7f1714067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17280b8820 tx=0x7f171c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:35.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.707+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f17280baca0 con 0x7f172806fc30 2024-01-24T12:44:35.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.855+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1728070ef0 con 0x7f172806fc30 2024-01-24T12:44:35.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f170ffff640 1 -- 172.21.15.27:0/4030025891 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1728070ef0 con 0x7f172806fc30 2024-01-24T12:44:35.859 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 msgr2=0x7f1714067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 0x7f1714067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f17280b8820 tx=0x7f171c008040 comp rx=0 tx=0).stop 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 msgr2=0x7f172813e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7b0 tx=0x7f171800cc70 comp rx=0 tx=0).stop 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 shutdown_connections 2024-01-24T12:44:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1714065a60 0x7f1714067f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1728147bc0 0x7f172813f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1728144100 0x7f17280bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 --2- 172.21.15.27:0/4030025891 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f172806fc30 0x7f172813e720 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 >> 172.21.15.27:0/4030025891 conn(0x7f172806a120 msgr2=0x7f172806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 shutdown_connections 2024-01-24T12:44:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:35.859+0000 7f172e066640 1 -- 172.21.15.27:0/4030025891 wait complete. 2024-01-24T12:44:35.887 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-24T12:44:35.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-01-24T12:44:36.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 Processor -- start 2024-01-24T12:44:36.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 -- start start 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f2ce8141b30 0x7f2ce8147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ce80b8020 0x7f2ce81481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce8071550 con 0x7f2ce80b8020 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce8071810 con 0x7f2ce8141b30 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cee59a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80bc720 con 0x7f2ce80bc340 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ce80b8020 0x7f2ce81481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2ce80b8020 0x7f2ce81481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54388/0 (socket says 172.21.15.27:54388) 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 -- 172.21.15.27:0/2951574795 learned_addr learned my addr 172.21.15.27:0/2951574795 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:36.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2ce7fff640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2ce77fe640 1 --2- 172.21.15.27:0/2951574795 >> v2:172.21.15.124:3300/0 conn(0x7f2ce8141b30 0x7f2ce8147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 -- 172.21.15.27:0/2951574795 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 msgr2=0x7f2ce81415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 -- 172.21.15.27:0/2951574795 >> v2:172.21.15.124:3300/0 conn(0x7f2ce8141b30 msgr2=0x7f2ce8147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 --2- 172.21.15.27:0/2951574795 >> v2:172.21.15.124:3300/0 conn(0x7f2ce8141b30 0x7f2ce8147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.011+0000 7f2cecb37640 1 -- 172.21.15.27:0/2951574795 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80b2d90 con 0x7f2ce80b8020 2024-01-24T12:44:36.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cecb37640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce81481a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2ce806d140 tx=0x7f2ce001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35285f69067f092d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:36.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce6ffd640 1 -- 172.21.15.27:0/2951574795 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00a55c0 con 0x7f2ce80b8020 2024-01-24T12:44:36.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce6ffd640 1 -- 172.21.15.27:0/2951574795 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00a5720 con 0x7f2ce80b8020 2024-01-24T12:44:36.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce6ffd640 1 -- 172.21.15.27:0/2951574795 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00a5ab0 con 0x7f2ce80b8020 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/2951574795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 msgr2=0x7f2ce81481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce81481a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2ce806d140 tx=0x7f2ce001c940 comp rx=0 tx=0).stop 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/2951574795 shutdown_connections 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- 172.21.15.27:0/2951574795 >> v2:172.21.15.124:3300/0 conn(0x7f2ce8141b30 0x7f2ce8147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce81481a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- 172.21.15.27:0/2951574795 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/2951574795 >> 172.21.15.27:0/2951574795 conn(0x7f2ce8069ef0 msgr2=0x7f2ce806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:36.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/2951574795 shutdown_connections 2024-01-24T12:44:36.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/2951574795 wait complete. 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 Processor -- start 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- start start 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ce8141b30 0x7f2ce81e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80b4900 con 0x7f2ce80b8020 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81e1280 con 0x7f2ce8141b30 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81e06b0 con 0x7f2ce80bc340 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54394/0 (socket says 172.21.15.27:54394) 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 -- 172.21.15.27:0/3537024981 learned_addr learned my addr 172.21.15.27:0/3537024981 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce77fe640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cecb37640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ce8141b30 0x7f2ce81e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 -- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 msgr2=0x7f2ce81e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 -- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ce8141b30 msgr2=0x7f2ce81e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ce8141b30 0x7f2ce81e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 -- 172.21.15.27:0/3537024981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009b30 con 0x7f2ce80b8020 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce7fff640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d800 tx=0x7f2cd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8009640 con 0x7f2ce80b8020 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd80097a0 con 0x7f2ce80b8020 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce81e0950 con 0x7f2ce80b8020 2024-01-24T12:44:36.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8009b10 con 0x7f2ce80b8020 2024-01-24T12:44:36.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.015+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce81e0f10 con 0x7f2ce80b8020 2024-01-24T12:44:36.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce804e000 con 0x7f2ce80b8020 2024-01-24T12:44:36.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2cd8009c70 con 0x7f2ce80b8020 2024-01-24T12:44:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2ce4ff9640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 0x7f2cd4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd8083a00 con 0x7f2ce80b8020 2024-01-24T12:44:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2ce77fe640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 0x7f2cd4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.019+0000 7f2ce77fe640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 0x7f2cd4067f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ce813b500 tx=0x7f2cdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:36.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.023+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2cd80512a0 con 0x7f2ce80b8020 2024-01-24T12:44:36.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:36.239+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f2ce8071c00 con 0x7f2ce80b8020 2024-01-24T12:44:37.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.099+0000 7f2ce4ff9640 1 -- 172.21.15.27:0/3537024981 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v48) v1 ==== 166+0+0 (secure 0 0 0) 0x7f2cd80548c0 con 0x7f2ce80b8020 2024-01-24T12:44:37.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 msgr2=0x7f2cd4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 0x7f2cd4067f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ce813b500 tx=0x7f2cdc008040 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 msgr2=0x7f2ce80b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d800 tx=0x7f2cd800dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 shutdown_connections 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2cd4065a90 0x7f2cd4067f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2ce8141b30 0x7f2ce81e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2ce80bc340 0x7f2ce81e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 --2- 172.21.15.27:0/3537024981 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2ce80b8020 0x7f2ce80b43c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 >> 172.21.15.27:0/3537024981 conn(0x7f2ce8069ef0 msgr2=0x7f2ce813c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 shutdown_connections 2024-01-24T12:44:37.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.103+0000 7f2cee59a640 1 -- 172.21.15.27:0/3537024981 wait complete. 2024-01-24T12:44:37.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-24T12:44:37.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 Processor -- start 2024-01-24T12:44:37.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 -- start start 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f311006b8d0 0x7f31101563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311006f0b0 con 0x7f311006b090 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31101451d0 con 0x7f311006f630 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f31182c1640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311014aad0 con 0x7f311006b8d0 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f311006b8d0 0x7f31101563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f311006b8d0 0x7f31101563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54402/0 (socket says 172.21.15.27:54402) 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 -- 172.21.15.27:0/1281265274 learned_addr learned my addr 172.21.15.27:0/1281265274 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 -- 172.21.15.27:0/1281265274 >> v1:172.21.15.124:6789/0 conn(0x7f311006f630 legacy=0x7f311014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 -- 172.21.15.27:0/1281265274 >> v1:172.21.15.27:6789/0 conn(0x7f311006b090 legacy=0x7f3110144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.254+0000 7f311685e640 1 -- 172.21.15.27:0/1281265274 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311006f350 con 0x7f311006b8d0 2024-01-24T12:44:37.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311685e640 1 --2- 172.21.15.27:0/1281265274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f31101563f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894f249330cc256 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311505b640 1 -- 172.21.15.27:0/1281265274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a89f0 con 0x7f311006b8d0 2024-01-24T12:44:37.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311505b640 1 -- 172.21.15.27:0/1281265274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c0a8b50 con 0x7f311006b8d0 2024-01-24T12:44:37.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311505b640 1 -- 172.21.15.27:0/1281265274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b0440 con 0x7f311006b8d0 2024-01-24T12:44:37.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- 172.21.15.27:0/1281265274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 msgr2=0x7f31101563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 --2- 172.21.15.27:0/1281265274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f31101563f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c01ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- 172.21.15.27:0/1281265274 shutdown_connections 2024-01-24T12:44:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 --2- 172.21.15.27:0/1281265274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f31101563f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- 172.21.15.27:0/1281265274 >> 172.21.15.27:0/1281265274 conn(0x7f31100babc0 msgr2=0x7f31100bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- 172.21.15.27:0/1281265274 shutdown_connections 2024-01-24T12:44:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- 172.21.15.27:0/1281265274 wait complete. 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 Processor -- start 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- start start 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 0x7f31101494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 0x7f31101d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311014adb0 con 0x7f311006b8d0 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110142d10 con 0x7f311006f630 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f31182c1640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31101d6410 con 0x7f311006b090 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54404/0 (socket says 172.21.15.27:54404) 2024-01-24T12:44:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 -- 172.21.15.27:0/763627089 learned_addr learned my addr 172.21.15.27:0/763627089 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311685e640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 0x7f31101d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311605d640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 0x7f31101494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 -- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 msgr2=0x7f31101494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 0x7f31101494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 -- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 msgr2=0x7f31101d5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 0x7f31101d5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311585c640 1 -- 172.21.15.27:0/763627089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0094d0 con 0x7f311006b8d0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311685e640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 0x7f31101d5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.258+0000 7f311605d640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 0x7f31101494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f311585c640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f310000b3e0 tx=0x7f310000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100011830 con 0x7f311006b8d0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31000119b0 con 0x7f311006b8d0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311014a300 con 0x7f311006b8d0 2024-01-24T12:44:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100011d60 con 0x7f311006b8d0 2024-01-24T12:44:37.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3110148cc0 con 0x7f311006b8d0 2024-01-24T12:44:37.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311004e000 con 0x7f311006b8d0 2024-01-24T12:44:37.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f310001a400 con 0x7f311006b8d0 2024-01-24T12:44:37.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 0x7f30f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3100083800 con 0x7f311006b8d0 2024-01-24T12:44:37.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f311605d640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 0x7f30f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.262+0000 7f311605d640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 0x7f30f4067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3108007fd0 tx=0x7f3108009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.266+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f31000512a0 con 0x7f311006b8d0 2024-01-24T12:44:37.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.430+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f31100b8570 con 0x7f311006b8d0 2024-01-24T12:44:37.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f3106ffd640 1 -- 172.21.15.27:0/763627089 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f31000548c0 con 0x7f311006b8d0 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 msgr2=0x7f30f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 0x7f30f4067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3108007fd0 tx=0x7f3108009040 comp rx=0 tx=0).stop 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 msgr2=0x7f3110142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f310000b3e0 tx=0x7f310000b8a0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 shutdown_connections 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f30f4065a60 0x7f30f4067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f311006f630 0x7f31101d5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f311006b8d0 0x7f3110142ec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 --2- 172.21.15.27:0/763627089 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f311006b090 0x7f31101494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 >> 172.21.15.27:0/763627089 conn(0x7f31100babc0 msgr2=0x7f31100b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:37.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 shutdown_connections 2024-01-24T12:44:37.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.438+0000 7f31182c1640 1 -- 172.21.15.27:0/763627089 wait complete. 2024-01-24T12:44:37.459 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T12:44:37.459 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T12:44:37.509 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T12:44:37.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T12:44:37.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T12:44:37.601 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:44:37.601 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T12:44:37.654 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:44:37.654 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T12:44:37.706 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:44:37.706 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T12:44:37.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:37.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 Processor -- start 2024-01-24T12:44:37.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 -- start start 2024-01-24T12:44:37.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7ff9ec0b8ce0 0x7ff9ec142c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec0b8820 0x7ff9ec0717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec071350 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec06fe30 con 0x7ff9ec0b8ce0 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f434a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec06f590 con 0x7ff9ec0b8820 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54416/0 (socket says 172.21.15.27:54416) 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 -- 172.21.15.27:0/4006370252 learned_addr learned my addr 172.21.15.27:0/4006370252 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f28e7640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec0b8820 0x7ff9ec0717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f18e5640 1 --2- 172.21.15.27:0/4006370252 >> v2:172.21.15.124:3300/0 conn(0x7ff9ec0b8ce0 0x7ff9ec142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 -- 172.21.15.27:0/4006370252 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec0b8820 msgr2=0x7ff9ec0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:37.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec0b8820 0x7ff9ec0717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 -- 172.21.15.27:0/4006370252 >> v2:172.21.15.124:3300/0 conn(0x7ff9ec0b8ce0 msgr2=0x7ff9ec142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/4006370252 >> v2:172.21.15.124:3300/0 conn(0x7ff9ec0b8ce0 0x7ff9ec142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.890+0000 7ff9f20e6640 1 -- 172.21.15.27:0/4006370252 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec06f870 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0679d0 tx=0x7ff9e801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568cd12e13c060ac server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f10e4640 1 -- 172.21.15.27:0/4006370252 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80a89b0 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f10e4640 1 -- 172.21.15.27:0/4006370252 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e80a8b10 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f10e4640 1 -- 172.21.15.27:0/4006370252 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80a8ea0 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- 172.21.15.27:0/4006370252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec06aaa0 msgr2=0x7ff9ec1426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0679d0 tx=0x7ff9e801ecf0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- 172.21.15.27:0/4006370252 shutdown_connections 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- 172.21.15.27:0/4006370252 >> v2:172.21.15.124:3300/0 conn(0x7ff9ec0b8ce0 0x7ff9ec142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec0b8820 0x7ff9ec0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- 172.21.15.27:0/4006370252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec06aaa0 0x7ff9ec1426c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- 172.21.15.27:0/4006370252 >> 172.21.15.27:0/4006370252 conn(0x7ff9ec069d20 msgr2=0x7ff9ec06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- 172.21.15.27:0/4006370252 shutdown_connections 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- 172.21.15.27:0/4006370252 wait complete. 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 Processor -- start 2024-01-24T12:44:37.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- start start 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec06aaa0 0x7ff9ec138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9ec0b8820 0x7ff9ec0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1386b0 con 0x7ff9ec1df870 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec135620 con 0x7ff9ec0b8820 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.894+0000 7ff9f434a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec149410 con 0x7ff9ec06aaa0 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54420/0 (socket says 172.21.15.27:54420) 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 -- 172.21.15.27:0/1730483582 learned_addr learned my addr 172.21.15.27:0/1730483582 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f18e5640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9ec0b8820 0x7ff9ec0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec06aaa0 0x7ff9ec138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 -- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec06aaa0 msgr2=0x7ff9ec138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec06aaa0 0x7ff9ec138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 -- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9ec0b8820 msgr2=0x7ff9ec0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9ec0b8820 0x7ff9ec0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 -- 172.21.15.27:0/1730483582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80094d0 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f28e7640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007e10 tx=0x7ff9e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4014620 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e40147a0 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec0b5950 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4014b50 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec149130 con 0x7ff9ec1df870 2024-01-24T12:44:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec04e000 con 0x7ff9ec1df870 2024-01-24T12:44:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9e4014cb0 con 0x7ff9ec1df870 2024-01-24T12:44:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 0x7ff9d0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9e4083a30 con 0x7ff9ec1df870 2024-01-24T12:44:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.898+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 0x7ff9d0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.902+0000 7ff9f20e6640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 0x7ff9d0067f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80b2000 tx=0x7ff9e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:37.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:37.902+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff9e4051480 con 0x7ff9ec1df870 2024-01-24T12:44:38.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.058+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ec06b2c0 con 0x7ff9ec1df870 2024-01-24T12:44:38.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9e2ffd640 1 -- 172.21.15.27:0/1730483582 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7ff9e4054aa0 con 0x7ff9ec1df870 2024-01-24T12:44:38.064 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:38.064 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:38.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 msgr2=0x7ff9d0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 0x7ff9d0067f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80b2000 tx=0x7ff9e8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 msgr2=0x7ff9ec1dfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007e10 tx=0x7ff9e400e4b0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 shutdown_connections 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff9d0065a90 0x7ff9d0067f50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff9ec1df870 0x7ff9ec1dfef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff9ec0b8820 0x7ff9ec0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 --2- 172.21.15.27:0/1730483582 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff9ec06aaa0 0x7ff9ec138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 >> 172.21.15.27:0/1730483582 conn(0x7ff9ec069d20 msgr2=0x7ff9ec13f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 shutdown_connections 2024-01-24T12:44:38.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.062+0000 7ff9f434a640 1 -- 172.21.15.27:0/1730483582 wait complete. 2024-01-24T12:44:38.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:38.083 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:38.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 Processor -- start 2024-01-24T12:44:38.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 -- start start 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3c680b8df0 0x7f3c68147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 0x7f3c68152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6806ec30 con 0x7f3c68070e40 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c680b30e0 con 0x7f3c680b8df0 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6e41c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c680b3770 con 0x7f3c680b8530 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3c680b8df0 0x7f3c68147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3c680b8df0 0x7f3c68147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54422/0 (socket says 172.21.15.27:54422) 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 -- 172.21.15.27:0/3512924539 learned_addr learned my addr 172.21.15.27:0/3512924539 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6c9b9640 1 --2- 172.21.15.27:0/3512924539 >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 0x7f3c68152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 -- 172.21.15.27:0/3512924539 >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 msgr2=0x7f3c68152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 --2- 172.21.15.27:0/3512924539 >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 0x7f3c68152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 -- 172.21.15.27:0/3512924539 >> v1:172.21.15.124:6789/0 conn(0x7f3c68070e40 legacy=0x7f3c68141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c67fff640 1 -- 172.21.15.27:0/3512924539 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68071890 con 0x7f3c680b8df0 2024-01-24T12:44:38.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.206+0000 7f3c6c9b9640 1 --2- 172.21.15.27:0/3512924539 >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 0x7f3c68152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:38.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- 172.21.15.27:0/3512924539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8df0 0x7f3c68147eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3c680b3490 tx=0x7f3c5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b6032f943f895c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c66ffd640 1 -- 172.21.15.27:0/3512924539 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580aa5f0 con 0x7f3c680b8df0 2024-01-24T12:44:38.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c66ffd640 1 -- 172.21.15.27:0/3512924539 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c580aa750 con 0x7f3c680b8df0 2024-01-24T12:44:38.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c66ffd640 1 -- 172.21.15.27:0/3512924539 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580aaae0 con 0x7f3c680b8df0 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/3512924539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8df0 msgr2=0x7f3c68147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/3512924539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8df0 0x7f3c68147eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3c680b3490 tx=0x7f3c5801c490 comp rx=0 tx=0).stop 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/3512924539 shutdown_connections 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/3512924539 >> v2:172.21.15.124:3300/0 conn(0x7f3c680b8530 0x7f3c68152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/3512924539 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8df0 0x7f3c68147eb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/3512924539 >> 172.21.15.27:0/3512924539 conn(0x7f3c6806a120 msgr2=0x7f3c6806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/3512924539 shutdown_connections 2024-01-24T12:44:38.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/3512924539 wait complete. 2024-01-24T12:44:38.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 Processor -- start 2024-01-24T12:44:38.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- start start 2024-01-24T12:44:38.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3c680b8df0 0x7f3c68146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c681e6830 0x7f3c681e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68146fc0 con 0x7f3c680b8530 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680b60a0 con 0x7f3c681e6830 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681394f0 con 0x7f3c680b8df0 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54424/0 (socket says 172.21.15.27:54424) 2024-01-24T12:44:38.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 -- 172.21.15.27:0/4018194466 learned_addr learned my addr 172.21.15.27:0/4018194466 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 -- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3c680b8df0 msgr2=0x7f3c68146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3c680b8df0 0x7f3c68146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 -- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c681e6830 msgr2=0x7f3c681e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c681e6830 0x7f3c681e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 -- 172.21.15.27:0/4018194466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580094d0 con 0x7f3c680b8530 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c67fff640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3c5801a0c0 tx=0x7f3c5801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580b3800 con 0x7f3c680b8530 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c580b3980 con 0x7f3c680b8530 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580b3d30 con 0x7f3c680b8530 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.210+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c68138f30 con 0x7f3c680b8530 2024-01-24T12:44:38.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c681e6310 con 0x7f3c680b8530 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c681e6500 con 0x7f3c680b8530 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c580c6440 con 0x7f3c680b8530 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c64ff9640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 0x7f3c54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c580a7070 con 0x7f3c680b8530 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c677fe640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 0x7f3c54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.214+0000 7f3c677fe640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 0x7f3c54067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3c680b6350 tx=0x7f3c5c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.218+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3c580eb750 con 0x7f3c680b8530 2024-01-24T12:44:38.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.366+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c6804e000 con 0x7f3c680b8530 2024-01-24T12:44:38.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c64ff9640 1 -- 172.21.15.27:0/4018194466 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c580eed70 con 0x7f3c680b8530 2024-01-24T12:44:38.371 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:38.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 msgr2=0x7f3c54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 0x7f3c54067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3c680b6350 tx=0x7f3c5c0079c0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 msgr2=0x7f3c68138850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3c5801a0c0 tx=0x7f3c5801acd0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 shutdown_connections 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3c54065a60 0x7f3c54067f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3c681e6830 0x7f3c681e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3c680b8df0 0x7f3c68146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 --2- 172.21.15.27:0/4018194466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3c680b8530 0x7f3c68138850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 >> 172.21.15.27:0/4018194466 conn(0x7f3c6806a120 msgr2=0x7f3c6806f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 shutdown_connections 2024-01-24T12:44:38.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.370+0000 7f3c6e41c640 1 -- 172.21.15.27:0/4018194466 wait complete. 2024-01-24T12:44:38.389 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:38.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 Processor -- start 2024-01-24T12:44:38.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 -- start start 2024-01-24T12:44:38.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdf680b8b40 0x7fdf680b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680b6e80 con 0x7fdf68144a80 2024-01-24T12:44:38.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680b7160 con 0x7fdf6814b370 2024-01-24T12:44:38.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6fdb2640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf680bc6c0 con 0x7fdf680b8b40 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6db4e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdf680b8b40 0x7fdf680b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6d34d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdf68144a80 0x7fdf6814ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51508/0 (socket says 172.21.15.27:51508) 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6db4e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdf680b8b40 0x7fdf680b8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54434/0 (socket says 172.21.15.27:54434) 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6d34d640 1 -- 172.21.15.27:0/2484074819 learned_addr learned my addr 172.21.15.27:0/2484074819 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6db4e640 1 -- 172.21.15.27:0/2484074819 >> v1:172.21.15.124:6789/0 conn(0x7fdf6814b370 legacy=0x7fdf681552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6db4e640 1 -- 172.21.15.27:0/2484074819 >> v1:172.21.15.27:6789/0 conn(0x7fdf68144a80 legacy=0x7fdf6814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.514+0000 7fdf6db4e640 1 -- 172.21.15.27:0/2484074819 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf680bc9a0 con 0x7fdf680b8b40 2024-01-24T12:44:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6db4e640 1 --2- 172.21.15.27:0/2484074819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf680b8b40 0x7fdf680b8f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf640097c0 tx=0x7fdf6401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b6d79b213109f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6cb4c640 1 -- 172.21.15.27:0/2484074819 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640a8930 con 0x7fdf680b8b40 2024-01-24T12:44:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6cb4c640 1 -- 172.21.15.27:0/2484074819 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf640a8a90 con 0x7fdf680b8b40 2024-01-24T12:44:38.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6cb4c640 1 -- 172.21.15.27:0/2484074819 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640a8e20 con 0x7fdf680b8b40 2024-01-24T12:44:38.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/2484074819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf680b8b40 msgr2=0x7fdf680b8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/2484074819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf680b8b40 0x7fdf680b8f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf640097c0 tx=0x7fdf6401ec30 comp rx=0 tx=0).stop 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/2484074819 shutdown_connections 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/2484074819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf680b8b40 0x7fdf680b8f20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/2484074819 >> 172.21.15.27:0/2484074819 conn(0x7fdf680c02f0 msgr2=0x7fdf680c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/2484074819 shutdown_connections 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/2484074819 wait complete. 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 Processor -- start 2024-01-24T12:44:38.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.518+0000 7fdf6fdb2640 1 -- start start 2024-01-24T12:44:38.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 0x7fdf681d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 0x7fdf680b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680b6160 con 0x7fdf6814b370 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68145f60 con 0x7fdf68144a80 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68146ef0 con 0x7fdf680b8b40 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54436/0 (socket says 172.21.15.27:54436) 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 -- 172.21.15.27:0/3030122249 learned_addr learned my addr 172.21.15.27:0/3030122249 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:38.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6db4e640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 0x7fdf681d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 -- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 msgr2=0x7fdf681d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 0x7fdf681d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6d34d640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 0x7fdf680b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 -- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 msgr2=0x7fdf680b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 0x7fdf680b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 -- 172.21.15.27:0/3030122249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009420 con 0x7fdf6814b370 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6db4e640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 0x7fdf681d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6d34d640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 0x7fdf680b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6e34f640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b9e0 tx=0x7fdf6000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60003b80 con 0x7fdf6814b370 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60003ce0 con 0x7fdf6814b370 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf681d1580 con 0x7fdf6814b370 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000cae0 con 0x7fdf6814b370 2024-01-24T12:44:38.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf68146490 con 0x7fdf6814b370 2024-01-24T12:44:38.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6804e000 con 0x7fdf6814b370 2024-01-24T12:44:38.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf6000cc40 con 0x7fdf6814b370 2024-01-24T12:44:38.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 0x7fdf4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf60082de0 con 0x7fdf6814b370 2024-01-24T12:44:38.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.522+0000 7fdf6db4e640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 0x7fdf4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.526+0000 7fdf6db4e640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 0x7fdf4c067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf640b2000 tx=0x7fdf640aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.526+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdf60050830 con 0x7fdf6814b370 2024-01-24T12:44:38.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf681d7a70 con 0x7fdf6814b370 2024-01-24T12:44:38.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf5e7fc640 1 -- 172.21.15.27:0/3030122249 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf681d7a70 con 0x7fdf6814b370 2024-01-24T12:44:38.680 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 msgr2=0x7fdf4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 0x7fdf4c067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf640b2000 tx=0x7fdf640aa070 comp rx=0 tx=0).stop 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 msgr2=0x7fdf681469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b9e0 tx=0x7fdf6000bea0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 shutdown_connections 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdf4c065a60 0x7fdf4c067f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdf6814b370 0x7fdf681469b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdf68144a80 0x7fdf680b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 --2- 172.21.15.27:0/3030122249 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdf680b8b40 0x7fdf681d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 >> 172.21.15.27:0/3030122249 conn(0x7fdf680c02f0 msgr2=0x7fdf68149a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 shutdown_connections 2024-01-24T12:44:38.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.678+0000 7fdf6fdb2640 1 -- 172.21.15.27:0/3030122249 wait complete. 2024-01-24T12:44:38.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:38.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 Processor -- start 2024-01-24T12:44:38.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 -- start start 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f90341427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f90340b5060 0x7f9034148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903406e220 con 0x7f90340a0c90 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90340ba850 con 0x7f90340b5060 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.806+0000 7f903b533640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903406df40 con 0x7f90340b44a0 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f90340a0c90 0x7f903414be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51520/0 (socket says 172.21.15.27:51520) 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 -- 172.21.15.27:0/154660934 learned_addr learned my addr 172.21.15.27:0/154660934 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480067012 0 0) 0x7f903406e220 con 0x7f90340a0c90 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f90392cf640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f90341427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003530 con 0x7f90340a0c90 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9038ace640 1 --2- 172.21.15.27:0/154660934 >> v2:172.21.15.124:3300/0 conn(0x7f90340b5060 0x7f9034148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1468363657 0 0) 0x7f9020003530 con 0x7f90340a0c90 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 msgr2=0x7f90341427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f90341427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 >> v2:172.21.15.124:3300/0 conn(0x7f90340b5060 msgr2=0x7f9034148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 --2- 172.21.15.27:0/154660934 >> v2:172.21.15.124:3300/0 conn(0x7f90340b5060 0x7f9034148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034148a00 con 0x7f90340a0c90 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f902c001680 con 0x7f90340a0c90 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 >> v1:172.21.15.27:6789/0 conn(0x7f90340a0c90 legacy=0x7f903414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f9020003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9020003f50 0x7f90200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9020004d10 0x7f9020005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340ba850 con 0x7f9020004d10 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903406df40 con 0x7f9020003f50 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902000b990 con 0x7f90340b44a0 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9020004d10 0x7f9020005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9038ace640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9020003f50 0x7f90200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f90392cf640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f9020003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 -- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 msgr2=0x7f9020003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90340b44a0 0x7f9020003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 -- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9020003f50 msgr2=0x7f90200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:38.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9020003f50 0x7f90200047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 -- 172.21.15.27:0/154660934 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020003530 con 0x7f9020004d10 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f9039ad0640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9020004d10 0x7f9020005190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c1c0 tx=0x7f902c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be94840716a4f9d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0058e0 con 0x7f9020004d10 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c005a60 con 0x7f9020004d10 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.810+0000 7f902bfff640 1 -- 172.21.15.27:0/154660934 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c005e50 con 0x7f9020004d10 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/154660934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9020004d10 msgr2=0x7f9020005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 --2- 172.21.15.27:0/154660934 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9020004d10 0x7f9020005190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c1c0 tx=0x7f902c01cc00 comp rx=0 tx=0).stop 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 -- 172.21.15.27:0/154660934 reap_dead start 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/154660934 shutdown_connections 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/154660934 >> 172.21.15.27:0/154660934 conn(0x7f90340babc0 msgr2=0x7f90340bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/154660934 shutdown_connections 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/154660934 wait complete. 2024-01-24T12:44:38.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 Processor -- start 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- start start 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90340a2420 0x7f903406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90341dfa20 0x7f90340b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90341e2f50 con 0x7f90341dfe40 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90341e3160 con 0x7f90340a2420 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90341e3440 con 0x7f90341dfa20 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54446/0 (socket says 172.21.15.27:54446) 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 -- 172.21.15.27:0/762021956 learned_addr learned my addr 172.21.15.27:0/762021956 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9038ace640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90341dfa20 0x7f90340b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f90392cf640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90340a2420 0x7f903406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 -- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90341dfa20 msgr2=0x7f90340b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90341dfa20 0x7f90340b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 -- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90340a2420 msgr2=0x7f903406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90340a2420 0x7f903406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 -- 172.21.15.27:0/762021956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90341e3720 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9039ad0640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ab040 tx=0x7f9020005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c004cc0 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c004e20 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90340b8210 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0a5a70 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90340a2800 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.814+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90340a2990 con 0x7f90341dfe40 2024-01-24T12:44:38.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.818+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f902c0a5bd0 con 0x7f90341dfe40 2024-01-24T12:44:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.818+0000 7f9029ffb640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 0x7f9018067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.818+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f902c11cb70 con 0x7f90341dfe40 2024-01-24T12:44:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.818+0000 7f90392cf640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 0x7f9018067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:38.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.818+0000 7f90392cf640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 0x7f9018067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90300074a0 tx=0x7f903000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:38.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.822+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f902c0ea4a0 con 0x7f90341dfe40 2024-01-24T12:44:38.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.974+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f903404e000 con 0x7f90341dfe40 2024-01-24T12:44:38.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f9029ffb640 1 -- 172.21.15.27:0/762021956 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f902c001b80 con 0x7f90341dfe40 2024-01-24T12:44:38.980 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:38.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 msgr2=0x7f9018067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 0x7f9018067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90300074a0 tx=0x7f903000d040 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 msgr2=0x7f90340b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ab040 tx=0x7f9020005800 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 shutdown_connections 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9018065a60 0x7f9018067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90341dfe40 0x7f90340b79a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f90341dfa20 0x7f90340b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 --2- 172.21.15.27:0/762021956 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f90340a2420 0x7f903406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 >> 172.21.15.27:0/762021956 conn(0x7f90340babc0 msgr2=0x7f9034147bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 shutdown_connections 2024-01-24T12:44:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:38.978+0000 7f903b533640 1 -- 172.21.15.27:0/762021956 wait complete. 2024-01-24T12:44:38.998 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T12:44:39.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 Processor -- start 2024-01-24T12:44:39.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 -- start start 2024-01-24T12:44:39.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb980708d0 0x7fbb98070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb98071a20 0x7fbb98147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980b2c80 con 0x7fbb9806eca0 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9806fdb0 con 0x7fbb980708d0 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9f49d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98070370 con 0x7fbb98071a20 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb980708d0 0x7fbb98070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb980708d0 0x7fbb98070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54448/0 (socket says 172.21.15.27:54448) 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 -- 172.21.15.27:0/1755000097 learned_addr learned my addr 172.21.15.27:0/1755000097 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9ca38640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb98071a20 0x7fbb98147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 -- 172.21.15.27:0/1755000097 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb98071a20 msgr2=0x7fbb98147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb98071a20 0x7fbb98147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 -- 172.21.15.27:0/1755000097 >> v1:172.21.15.27:6789/0 conn(0x7fbb9806eca0 legacy=0x7fbb981440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.122+0000 7fbb9d239640 1 -- 172.21.15.27:0/1755000097 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980b2ed0 con 0x7fbb980708d0 2024-01-24T12:44:39.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9d239640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb98070cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb9401d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16f995525bc38e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8ffff640 1 -- 172.21.15.27:0/1755000097 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb940aa400 con 0x7fbb980708d0 2024-01-24T12:44:39.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8ffff640 1 -- 172.21.15.27:0/1755000097 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb940aa560 con 0x7fbb980708d0 2024-01-24T12:44:39.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8ffff640 1 -- 172.21.15.27:0/1755000097 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb940aa8f0 con 0x7fbb980708d0 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/1755000097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 msgr2=0x7fbb98070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb98070cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009870 tx=0x7fbb9401d620 comp rx=0 tx=0).stop 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/1755000097 shutdown_connections 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb98071a20 0x7fbb98147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/1755000097 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb98070cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/1755000097 >> 172.21.15.27:0/1755000097 conn(0x7fbb98069ef0 msgr2=0x7fbb9806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/1755000097 shutdown_connections 2024-01-24T12:44:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/1755000097 wait complete. 2024-01-24T12:44:39.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 Processor -- start 2024-01-24T12:44:39.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- start start 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb9806eca0 0x7fbb98140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbb98071a20 0x7fbb981e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98141120 con 0x7fbb980708d0 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981e70c0 con 0x7fbb98071a20 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9813b800 con 0x7fbb9806eca0 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54462/0 (socket says 172.21.15.27:54462) 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 -- 172.21.15.27:0/2507240980 learned_addr learned my addr 172.21.15.27:0/2507240980 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9d239640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb9806eca0 0x7fbb98140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 -- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb9806eca0 msgr2=0x7fbb98140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb9806eca0 0x7fbb98140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 -- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbb98071a20 msgr2=0x7fbb981e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9da3a640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbb98071a20 0x7fbb981e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbb98071a20 0x7fbb981e35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 -- 172.21.15.27:0/2507240980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940094d0 con 0x7fbb980708d0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9ca38640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d620 tx=0x7fbb8800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800b620 con 0x7fbb980708d0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8800b780 con 0x7fbb980708d0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9813ba70 con 0x7fbb980708d0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800bb10 con 0x7fbb980708d0 2024-01-24T12:44:39.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.126+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb981e6d50 con 0x7fbb980708d0 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb980b5cf0 con 0x7fbb980708d0 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb8800bc70 con 0x7fbb980708d0 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb8dffb640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 0x7fbb7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb88083610 con 0x7fbb980708d0 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb9d239640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 0x7fbb7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.130+0000 7fbb9d239640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 0x7fbb7c067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb940af000 tx=0x7fbb940b4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.134+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbb980b5cf0 con 0x7fbb980708d0 2024-01-24T12:44:39.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.294+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb981e7270 con 0x7fbb980708d0 2024-01-24T12:44:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb8dffb640 1 -- 172.21.15.27:0/2507240980 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb981e7270 con 0x7fbb980708d0 2024-01-24T12:44:39.299 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-24T12:44:39.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 msgr2=0x7fbb7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 0x7fbb7c067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb940af000 tx=0x7fbb940b4040 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 msgr2=0x7fbb981e3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d620 tx=0x7fbb8800dae0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 shutdown_connections 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbb7c065a60 0x7fbb7c067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbb98071a20 0x7fbb981e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb980708d0 0x7fbb981e3060 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 --2- 172.21.15.27:0/2507240980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbb9806eca0 0x7fbb98140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 >> 172.21.15.27:0/2507240980 conn(0x7fbb98069ef0 msgr2=0x7fbb9806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 shutdown_connections 2024-01-24T12:44:39.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.298+0000 7fbb9f49d640 1 -- 172.21.15.27:0/2507240980 wait complete. 2024-01-24T12:44:39.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-24T12:44:39.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:39.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-24T12:44:39.356 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-24T12:44:39.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:39.356 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T12:44:39.418 INFO:tasks.cephfs.cephfs_test_case:[] 2024-01-24T12:44:39.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.538+0000 7f548ad2e640 1 Processor -- start 2024-01-24T12:44:39.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.538+0000 7f548ad2e640 1 -- start start 2024-01-24T12:44:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f548ad2e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f548406a900 0x7f5484156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f548ad2e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840bb370 con 0x7f548414b540 2024-01-24T12:44:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f548ad2e640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840bc590 con 0x7f548406a4c0 2024-01-24T12:44:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f548ad2e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54840bc320 con 0x7f548406a900 2024-01-24T12:44:39.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f5488aca640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f548414b540 0x7f54840bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51530/0 (socket says 172.21.15.27:51530) 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f5488aca640 1 -- 172.21.15.27:0/2501527708 learned_addr learned my addr 172.21.15.27:0/2501527708 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54892cb640 1 --2- 172.21.15.27:0/2501527708 >> v2:172.21.15.27:3300/0 conn(0x7f548406a900 0x7f5484156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54837fe640 1 -- 172.21.15.27:0/2501527708 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99382784 0 0) 0x7f54840bb370 con 0x7f548414b540 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54837fe640 1 -- 172.21.15.27:0/2501527708 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f546c003530 con 0x7f548414b540 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54892cb640 1 -- 172.21.15.27:0/2501527708 >> v1:172.21.15.124:6789/0 conn(0x7f548406a4c0 legacy=0x7f54841532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54892cb640 1 -- 172.21.15.27:0/2501527708 >> v1:172.21.15.27:6789/0 conn(0x7f548414b540 legacy=0x7f54840bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54892cb640 1 -- 172.21.15.27:0/2501527708 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840b3a10 con 0x7f548406a900 2024-01-24T12:44:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54892cb640 1 --2- 172.21.15.27:0/2501527708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a900 0x7f5484156a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f547c009d90 tx=0x7f547c01f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f2a0e5a2794e85 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54837fe640 1 -- 172.21.15.27:0/2501527708 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0af600 con 0x7f548406a900 2024-01-24T12:44:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54837fe640 1 -- 172.21.15.27:0/2501527708 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0ab050 con 0x7f548406a900 2024-01-24T12:44:39.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.542+0000 7f54837fe640 1 -- 172.21.15.27:0/2501527708 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0af980 con 0x7f548406a900 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/2501527708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a900 msgr2=0x7f5484156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 --2- 172.21.15.27:0/2501527708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a900 0x7f5484156a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f547c009d90 tx=0x7f547c01f100 comp rx=0 tx=0).stop 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/2501527708 shutdown_connections 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 --2- 172.21.15.27:0/2501527708 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a900 0x7f5484156a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/2501527708 >> 172.21.15.27:0/2501527708 conn(0x7f54840c02e0 msgr2=0x7f54840c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/2501527708 shutdown_connections 2024-01-24T12:44:39.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/2501527708 wait complete. 2024-01-24T12:44:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 Processor -- start 2024-01-24T12:44:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- start start 2024-01-24T12:44:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f548406a900 0x7f54840b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f548414b540 0x7f54841e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b5aa0 con 0x7f548406a4c0 2024-01-24T12:44:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ba160 con 0x7f548414b540 2024-01-24T12:44:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ba910 con 0x7f548406a900 2024-01-24T12:44:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54472/0 (socket says 172.21.15.27:54472) 2024-01-24T12:44:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 -- 172.21.15.27:0/439522242 learned_addr learned my addr 172.21.15.27:0/439522242 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f54892cb640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f548414b540 0x7f54841e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 -- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f548406a900 msgr2=0x7f54840b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f548406a900 0x7f54840b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 -- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f548414b540 msgr2=0x7f54841e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f548414b540 0x7f54841e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 -- 172.21.15.27:0/439522242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c009a70 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f5488aca640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f547400c500 tx=0x7f547400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474005cf0 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474005e50 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740072f0 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54840b94b0 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54840ba630 con 0x7f548406a4c0 2024-01-24T12:44:39.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.546+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54840bf980 con 0x7f548406a4c0 2024-01-24T12:44:39.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.550+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5474007450 con 0x7f548406a4c0 2024-01-24T12:44:39.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.550+0000 7f54817fa640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 0x7f5470067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.550+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5474082a80 con 0x7f548406a4c0 2024-01-24T12:44:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.550+0000 7f5483fff640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 0x7f5470067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.550+0000 7f5483fff640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 0x7f5470067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54840bf170 tx=0x7f5478006bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.554+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5474050660 con 0x7f548406a4c0 2024-01-24T12:44:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.738+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f548404e000 con 0x7f548406a4c0 2024-01-24T12:44:39.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f54817fa640 1 -- 172.21.15.27:0/439522242 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f5474021090 con 0x7f548406a4c0 2024-01-24T12:44:39.743 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:39.744 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 msgr2=0x7f5470067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 0x7f5470067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54840bf170 tx=0x7f5478006bd0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 msgr2=0x7f54840b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f547400c500 tx=0x7f547400c9c0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 shutdown_connections 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5470065a60 0x7f5470067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f548414b540 0x7f54841e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f548406a900 0x7f54840b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 --2- 172.21.15.27:0/439522242 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f548406a4c0 0x7f54840b8f70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 >> 172.21.15.27:0/439522242 conn(0x7f54840c02e0 msgr2=0x7f54840a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 shutdown_connections 2024-01-24T12:44:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.742+0000 7f548ad2e640 1 -- 172.21.15.27:0/439522242 wait complete. 2024-01-24T12:44:39.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:39.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 Processor -- start 2024-01-24T12:44:39.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 -- start start 2024-01-24T12:44:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ae00bc340 0x7f1ae01415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f1ae0141b30 0x7f1ae0147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae0071550 con 0x7f1ae00b8020 2024-01-24T12:44:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0071810 con 0x7f1ae00bc340 2024-01-24T12:44:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae6e25640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0071950 con 0x7f1ae0141b30 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae53c2640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1ae00b8020 0x7f1ae014abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51538/0 (socket says 172.21.15.27:51538) 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae53c2640 1 -- 172.21.15.27:0/3880748754 learned_addr learned my addr 172.21.15.27:0/3880748754 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.878+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/3880748754 >> v2:172.21.15.27:3300/0 conn(0x7f1ae00bc340 0x7f1ae01415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adffff640 1 --2- 172.21.15.27:0/3880748754 >> v2:172.21.15.124:3300/0 conn(0x7f1ae0141b30 0x7f1ae0147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adf7fe640 1 -- 172.21.15.27:0/3880748754 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987105993 0 0) 0x7f1ae0071550 con 0x7f1ae00b8020 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adf7fe640 1 -- 172.21.15.27:0/3880748754 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1acc003530 con 0x7f1ae00b8020 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae4bc1640 1 -- 172.21.15.27:0/3880748754 >> v2:172.21.15.124:3300/0 conn(0x7f1ae0141b30 msgr2=0x7f1ae0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/3880748754 >> v2:172.21.15.124:3300/0 conn(0x7f1ae0141b30 0x7f1ae0147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae4bc1640 1 -- 172.21.15.27:0/3880748754 >> v1:172.21.15.27:6789/0 conn(0x7f1ae00b8020 legacy=0x7f1ae014abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae4bc1640 1 -- 172.21.15.27:0/3880748754 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00bc720 con 0x7f1ae00bc340 2024-01-24T12:44:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/3880748754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae00bc340 0x7f1ae01415f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ae006b260 tx=0x7f1ac801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5440cf77851d14a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adf7fe640 1 -- 172.21.15.27:0/3880748754 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80ab600 con 0x7f1ae00bc340 2024-01-24T12:44:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adf7fe640 1 -- 172.21.15.27:0/3880748754 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac80a7050 con 0x7f1ae00bc340 2024-01-24T12:44:39.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1adf7fe640 1 -- 172.21.15.27:0/3880748754 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80ab980 con 0x7f1ae00bc340 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 -- 172.21.15.27:0/3880748754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae00bc340 msgr2=0x7f1ae01415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/3880748754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae00bc340 0x7f1ae01415f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ae006b260 tx=0x7f1ac801c3b0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 -- 172.21.15.27:0/3880748754 shutdown_connections 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/3880748754 >> v2:172.21.15.124:3300/0 conn(0x7f1ae0141b30 0x7f1ae0147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/3880748754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae00bc340 0x7f1ae01415f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 -- 172.21.15.27:0/3880748754 >> 172.21.15.27:0/3880748754 conn(0x7f1ae0069ef0 msgr2=0x7f1ae006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 -- 172.21.15.27:0/3880748754 shutdown_connections 2024-01-24T12:44:39.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.882+0000 7f1ae6e25640 1 -- 172.21.15.27:0/3880748754 wait complete. 2024-01-24T12:44:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 Processor -- start 2024-01-24T12:44:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- start start 2024-01-24T12:44:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 0x7f1ae00b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 0x7f1ae01465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0146b00 con 0x7f1ae0141b30 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae01e2f80 con 0x7f1ae00b8020 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00b9eb0 con 0x7f1ae00bc340 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54502/0 (socket says 172.21.15.27:54502) 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 -- 172.21.15.27:0/719206215 learned_addr learned my addr 172.21.15.27:0/719206215 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 0x7f1ae00b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1adffff640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 0x7f1ae01465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 -- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 msgr2=0x7f1ae01465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 0x7f1ae01465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 -- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 msgr2=0x7f1ae00b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 0x7f1ae00b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 -- 172.21.15.27:0/719206215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009420 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1adffff640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 0x7f1ae01465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 0x7f1ae00b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae53c2640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cbb0 tx=0x7f1ad800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800ad40 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8012400 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00b5990 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800aea0 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae01e31d0 con 0x7f1ae0141b30 2024-01-24T12:44:39.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae004e000 con 0x7f1ae0141b30 2024-01-24T12:44:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ad8007070 con 0x7f1ae0141b30 2024-01-24T12:44:39.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 0x7f1ac0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.886+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad8083000 con 0x7f1ae0141b30 2024-01-24T12:44:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.890+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 0x7f1ac0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:39.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.890+0000 7f1ae4bc1640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 0x7f1ac0067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80ad000 tx=0x7f1ac8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:39.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:39.890+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f1ad8050b00 con 0x7f1ae0141b30 2024-01-24T12:44:40.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.042+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae00b4f50 con 0x7f1ae0141b30 2024-01-24T12:44:40.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.042+0000 7f1add7fa640 1 -- 172.21.15.27:0/719206215 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f1ad8017090 con 0x7f1ae0141b30 2024-01-24T12:44:40.045 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:40.045 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 msgr2=0x7f1ac0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 0x7f1ac0067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80ad000 tx=0x7f1ac8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 msgr2=0x7f1ae01e36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800cbb0 tx=0x7f1ad800a430 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 shutdown_connections 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1ac0065a60 0x7f1ac0067f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ae0141b30 0x7f1ae01e36f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1ae00bc340 0x7f1ae01465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 --2- 172.21.15.27:0/719206215 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f1ae00b8020 0x7f1ae00b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 >> 172.21.15.27:0/719206215 conn(0x7f1ae0069ef0 msgr2=0x7f1ae006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 shutdown_connections 2024-01-24T12:44:40.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.046+0000 7f1ae6e25640 1 -- 172.21.15.27:0/719206215 wait complete. 2024-01-24T12:44:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:09.860199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:10.262181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:40.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:40.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 Processor -- start 2024-01-24T12:44:40.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 -- start start 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4fa00b3320 0x7f4fa01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa0148a80 con 0x7f4fa00b8df0 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00b3890 con 0x7f4fa00b8540 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa7320640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00b3b70 con 0x7f4fa00b3320 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa50bc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4fa00b8df0 0x7f4fa0142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51544/0 (socket says 172.21.15.27:51544) 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa50bc640 1 -- 172.21.15.27:0/1407307665 learned_addr learned my addr 172.21.15.27:0/1407307665 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa58bd640 1 --2- 172.21.15.27:0/1407307665 >> v2:172.21.15.27:3300/0 conn(0x7f4fa00b3320 0x7f4fa01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4f97fff640 1 -- 172.21.15.27:0/1407307665 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258803540 0 0) 0x7f4fa0148a80 con 0x7f4fa00b8df0 2024-01-24T12:44:40.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa58bd640 1 -- 172.21.15.27:0/1407307665 >> v1:172.21.15.124:6789/0 conn(0x7f4fa00b8540 legacy=0x7f4fa0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:40.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa58bd640 1 -- 172.21.15.27:0/1407307665 >> v1:172.21.15.27:6789/0 conn(0x7f4fa00b8df0 legacy=0x7f4fa0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.182+0000 7f4fa58bd640 1 -- 172.21.15.27:0/1407307665 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00b3e50 con 0x7f4fa00b3320 2024-01-24T12:44:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa58bd640 1 --2- 172.21.15.27:0/1407307665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b3320 0x7f4fa01541c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf0254de08577b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f97fff640 1 -- 172.21.15.27:0/1407307665 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980a5970 con 0x7f4fa00b3320 2024-01-24T12:44:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f97fff640 1 -- 172.21.15.27:0/1407307665 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980a5ad0 con 0x7f4fa00b3320 2024-01-24T12:44:40.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f97fff640 1 -- 172.21.15.27:0/1407307665 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980a5e60 con 0x7f4fa00b3320 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/1407307665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b3320 msgr2=0x7f4fa01541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 --2- 172.21.15.27:0/1407307665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b3320 0x7f4fa01541c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801c910 comp rx=0 tx=0).stop 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/1407307665 shutdown_connections 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 --2- 172.21.15.27:0/1407307665 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b3320 0x7f4fa01541c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/1407307665 >> 172.21.15.27:0/1407307665 conn(0x7f4fa006a120 msgr2=0x7f4fa006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/1407307665 shutdown_connections 2024-01-24T12:44:40.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/1407307665 wait complete. 2024-01-24T12:44:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 Processor -- start 2024-01-24T12:44:40.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- start start 2024-01-24T12:44:40.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fa00b3320 0x7f4fa013dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4fa00b8df0 0x7f4fa01e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0138580 con 0x7f4fa00b8540 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0147bf0 con 0x7f4fa00b3320 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa01486b0 con 0x7f4fa00b8df0 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54518/0 (socket says 172.21.15.27:54518) 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 -- 172.21.15.27:0/276282881 learned_addr learned my addr 172.21.15.27:0/276282881 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa50bc640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fa00b3320 0x7f4fa013dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa58bd640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4fa00b8df0 0x7f4fa01e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 -- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4fa00b8df0 msgr2=0x7f4fa01e3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4fa00b8df0 0x7f4fa01e3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 -- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fa00b3320 msgr2=0x7f4fa013dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fa00b3320 0x7f4fa013dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 -- 172.21.15.27:0/276282881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009a70 con 0x7f4fa00b8540 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa48bb640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c450 tx=0x7f4f9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012830 con 0x7f4fa00b8540 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900129b0 con 0x7f4fa00b8540 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa0147eb0 con 0x7f4fa00b8540 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012d60 con 0x7f4fa00b8540 2024-01-24T12:44:40.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.186+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa01417c0 con 0x7f4fa00b8540 2024-01-24T12:44:40.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa01495a0 con 0x7f4fa00b8540 2024-01-24T12:44:40.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f9001c460 con 0x7f4fa00b8540 2024-01-24T12:44:40.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4f95ffb640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 0x7f4f84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f90082f90 con 0x7f4fa00b8540 2024-01-24T12:44:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4fa50bc640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 0x7f4f84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.190+0000 7f4fa50bc640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 0x7f4f84067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000f70 tx=0x7f4f9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.194+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4f900b40b0 con 0x7f4fa00b8540 2024-01-24T12:44:40.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.350+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fa004e000 con 0x7f4fa00b8540 2024-01-24T12:44:40.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.350+0000 7f4f95ffb640 1 -- 172.21.15.27:0/276282881 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f900509e0 con 0x7f4fa00b8540 2024-01-24T12:44:40.353 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 msgr2=0x7f4f84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 0x7f4f84067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000f70 tx=0x7f4f9c009040 comp rx=0 tx=0).stop 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 msgr2=0x7f4fa0138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c450 tx=0x7f4f9000c910 comp rx=0 tx=0).stop 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 shutdown_connections 2024-01-24T12:44:40.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4f84065a60 0x7f4f84067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4fa00b8df0 0x7f4fa01e3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00b8540 0x7f4fa0138040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 --2- 172.21.15.27:0/276282881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4fa00b3320 0x7f4fa013dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 >> 172.21.15.27:0/276282881 conn(0x7f4fa006a120 msgr2=0x7f4fa00b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 shutdown_connections 2024-01-24T12:44:40.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.354+0000 7f4fa7320640 1 -- 172.21.15.27:0/276282881 wait complete. 2024-01-24T12:44:40.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T12:44:40.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.494+0000 7f297bcab640 1 Processor -- start 2024-01-24T12:44:40.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.494+0000 7f297bcab640 1 -- start start 2024-01-24T12:44:40.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f29740b8df0 0x7f2974142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29740b8540 0x7f2974148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2974148a80 con 0x7f2974142d80 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740b3890 con 0x7f29740b8540 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29740b3b70 con 0x7f29740b8df0 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f29740b8540 0x7f2974148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297a248640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2974142d80 0x7f29740b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51550/0 (socket says 172.21.15.27:51550) 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297a248640 1 -- 172.21.15.27:0/4239391241 learned_addr learned my addr 172.21.15.27:0/4239391241 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979a47640 1 --2- 172.21.15.27:0/4239391241 >> v2:172.21.15.124:3300/0 conn(0x7f29740b8df0 0x7f2974142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 -- 172.21.15.27:0/4239391241 >> v2:172.21.15.124:3300/0 conn(0x7f29740b8df0 msgr2=0x7f2974142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 --2- 172.21.15.27:0/4239391241 >> v2:172.21.15.124:3300/0 conn(0x7f29740b8df0 0x7f2974142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 -- 172.21.15.27:0/4239391241 >> v1:172.21.15.27:6789/0 conn(0x7f2974142d80 legacy=0x7f29740b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 -- 172.21.15.27:0/4239391241 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740b3e50 con 0x7f29740b8540 2024-01-24T12:44:40.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2978a45640 1 -- 172.21.15.27:0/4239391241 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564605157 0 0) 0x7f2974148a80 con 0x7f2974142d80 2024-01-24T12:44:40.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2979246640 1 --2- 172.21.15.27:0/4239391241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29740b8540 0x7f2974148f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29740b9a80 tx=0x7f296401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda7f04642856b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2978a45640 1 -- 172.21.15.27:0/4239391241 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974071930 con 0x7f29740b8540 2024-01-24T12:44:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2978a45640 1 -- 172.21.15.27:0/4239391241 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29640ab680 con 0x7f29740b8540 2024-01-24T12:44:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f2978a45640 1 -- 172.21.15.27:0/4239391241 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29640aba10 con 0x7f29740b8540 2024-01-24T12:44:40.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- 172.21.15.27:0/4239391241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29740b8540 msgr2=0x7f2974148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 --2- 172.21.15.27:0/4239391241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29740b8540 0x7f2974148f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29740b9a80 tx=0x7f296401c460 comp rx=0 tx=0).stop 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- 172.21.15.27:0/4239391241 shutdown_connections 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 --2- 172.21.15.27:0/4239391241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29740b8540 0x7f2974148f10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 --2- 172.21.15.27:0/4239391241 >> v2:172.21.15.124:3300/0 conn(0x7f29740b8df0 0x7f2974142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- 172.21.15.27:0/4239391241 >> 172.21.15.27:0/4239391241 conn(0x7f297406a120 msgr2=0x7f297406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- 172.21.15.27:0/4239391241 shutdown_connections 2024-01-24T12:44:40.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.498+0000 7f297bcab640 1 -- 172.21.15.27:0/4239391241 wait complete. 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 Processor -- start 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- start start 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29740b8540 0x7f297413b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 0x7f2974070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297413b900 con 0x7f2974142d80 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297406f110 con 0x7f29740b8540 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2974070760 con 0x7f29740b8df0 2024-01-24T12:44:40.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54538/0 (socket says 172.21.15.27:54538) 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 -- 172.21.15.27:0/595646478 learned_addr learned my addr 172.21.15.27:0/595646478 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f2979a47640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29740b8540 0x7f297413b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f2979246640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 0x7f2974070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 -- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 msgr2=0x7f2974070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 0x7f2974070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 -- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29740b8540 msgr2=0x7f297413b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29740b8540 0x7f297413b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 -- 172.21.15.27:0/595646478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009420 con 0x7f2974142d80 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f2979246640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 0x7f2974070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297a248640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f296c00c750 tx=0x7f296c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00ce60 con 0x7f2974142d80 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c00a640 con 0x7f2974142d80 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297406f350 con 0x7f2974142d80 2024-01-24T12:44:40.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00a9b0 con 0x7f2974142d80 2024-01-24T12:44:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297406f6e0 con 0x7f2974142d80 2024-01-24T12:44:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2974153ee0 con 0x7f2974142d80 2024-01-24T12:44:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.502+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f296c00ab10 con 0x7f2974142d80 2024-01-24T12:44:40.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.506+0000 7f296a7fc640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 0x7f2958067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.506+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f296c082900 con 0x7f2974142d80 2024-01-24T12:44:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.506+0000 7f2979a47640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 0x7f2958067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.506+0000 7f2979a47640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 0x7f2958067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2970007a60 tx=0x7f2970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.510+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f296c050400 con 0x7f2974142d80 2024-01-24T12:44:40.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.658+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2974138770 con 0x7f2974142d80 2024-01-24T12:44:40.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f296a7fc640 1 -- 172.21.15.27:0/595646478 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2974138770 con 0x7f2974142d80 2024-01-24T12:44:40.663 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T12:44:40.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 msgr2=0x7f2958067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 0x7f2958067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2970007a60 tx=0x7f2970008040 comp rx=0 tx=0).stop 2024-01-24T12:44:40.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 msgr2=0x7f2974138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f296c00c750 tx=0x7f296c00cc10 comp rx=0 tx=0).stop 2024-01-24T12:44:40.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 shutdown_connections 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2958065a60 0x7f2958067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2974142d80 0x7f2974138a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f29740b8df0 0x7f2974070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 --2- 172.21.15.27:0/595646478 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f29740b8540 0x7f297413b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 >> 172.21.15.27:0/595646478 conn(0x7f297406a120 msgr2=0x7f29740b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 shutdown_connections 2024-01-24T12:44:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.662+0000 7f297bcab640 1 -- 172.21.15.27:0/595646478 wait complete. 2024-01-24T12:44:40.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T12:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 Processor -- start 2024-01-24T12:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 -- start start 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe6600b8540 0x7fe660148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6600b3320 0x7fe660149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe660148a80 con 0x7fe6600b8df0 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600b3890 con 0x7fe6600b8540 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe665eac640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600b3b70 con 0x7fe6600b3320 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65f7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe6600b8df0 0x7fe660142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51556/0 (socket says 172.21.15.27:51556) 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65f7fe640 1 -- 172.21.15.27:0/2902650889 learned_addr learned my addr 172.21.15.27:0/2902650889 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe656ffd640 1 --2- 172.21.15.27:0/2902650889 >> v2:172.21.15.27:3300/0 conn(0x7fe6600b8540 0x7fe660148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65ffff640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6600b3320 0x7fe660149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387899896 0 0) 0x7fe660148a80 con 0x7fe6600b8df0 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003530 con 0x7fe6600b8df0 2024-01-24T12:44:40.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe656ffd640 1 -- 172.21.15.27:0/2902650889 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6600b3320 msgr2=0x7fe660149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:40.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe656ffd640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6600b3320 0x7fe660149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe656ffd640 1 -- 172.21.15.27:0/2902650889 >> v1:172.21.15.27:6789/0 conn(0x7fe6600b8df0 legacy=0x7fe660142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3191147722 0 0) 0x7fe64c003530 con 0x7fe6600b8df0 2024-01-24T12:44:40.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.798+0000 7fe656ffd640 1 -- 172.21.15.27:0/2902650889 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600b3e50 con 0x7fe6600b8540 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8540 0x7fe660148f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe6480097c0 tx=0x7fe64801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4cee2d4021a694 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650001680 con 0x7fe6600b8540 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480a7050 con 0x7fe6600b8540 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65effd640 1 -- 172.21.15.27:0/2902650889 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480ab620 con 0x7fe6600b8540 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/2902650889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8540 msgr2=0x7fe660148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8540 0x7fe660148f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe6480097c0 tx=0x7fe64801c3a0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/2902650889 shutdown_connections 2024-01-24T12:44:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6600b3320 0x7fe660149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- 172.21.15.27:0/2902650889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8540 0x7fe660148f10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/2902650889 >> 172.21.15.27:0/2902650889 conn(0x7fe66006a120 msgr2=0x7fe66006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/2902650889 shutdown_connections 2024-01-24T12:44:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/2902650889 wait complete. 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 Processor -- start 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- start start 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 0x7fe660139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6601480c0 0x7fe66014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600bca60 con 0x7fe6600b8df0 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660147400 con 0x7fe6600b3320 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe660146b10 con 0x7fe6601480c0 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54554/0 (socket says 172.21.15.27:54554) 2024-01-24T12:44:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 -- 172.21.15.27:0/242363878 learned_addr learned my addr 172.21.15.27:0/242363878 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65ffff640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6601480c0 0x7fe66014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65f7fe640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 0x7fe660139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 -- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6601480c0 msgr2=0x7fe66014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6601480c0 0x7fe66014ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 -- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 msgr2=0x7fe660139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 0x7fe660139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 -- 172.21.15.27:0/242363878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe648009420 con 0x7fe6600b8df0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65f7fe640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 0x7fe660139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe656ffd640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe648019fd0 tx=0x7fe648019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648006e20 con 0x7fe6600b8df0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480b4410 con 0x7fe6600b8df0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480b47a0 con 0x7fe6600b8df0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe660148650 con 0x7fe6600b8df0 2024-01-24T12:44:40.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.802+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660146db0 con 0x7fe6600b8df0 2024-01-24T12:44:40.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66004e000 con 0x7fe6600b8df0 2024-01-24T12:44:40.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6480b2040 con 0x7fe6600b8df0 2024-01-24T12:44:40.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe65cff9640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 0x7fe640067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:40.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe64811c880 con 0x7fe6600b8df0 2024-01-24T12:44:40.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe65f7fe640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 0x7fe640067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:40.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.806+0000 7fe65f7fe640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 0x7fe640067f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe650005890 tx=0x7fe650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:40.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.810+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe6480ea2d0 con 0x7fe6600b8df0 2024-01-24T12:44:40.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:40.840 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:40.843 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:44:40.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.958+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe660142af0 con 0x7fe6600b8df0 2024-01-24T12:44:40.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe65cff9640 1 -- 172.21.15.27:0/242363878 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6480b0020 con 0x7fe6600b8df0 2024-01-24T12:44:40.963 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 msgr2=0x7fe640067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 0x7fe640067f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe650005890 tx=0x7fe650009040 comp rx=0 tx=0).stop 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 msgr2=0x7fe660147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe648019fd0 tx=0x7fe648019140 comp rx=0 tx=0).stop 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 shutdown_connections 2024-01-24T12:44:40.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe640065a90 0x7fe640067f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe6601480c0 0x7fe66014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6600b8df0 0x7fe660147b80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 --2- 172.21.15.27:0/242363878 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe6600b3320 0x7fe660139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 >> 172.21.15.27:0/242363878 conn(0x7fe66006a120 msgr2=0x7fe660140380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 shutdown_connections 2024-01-24T12:44:40.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:40.962+0000 7fe665eac640 1 -- 172.21.15.27:0/242363878 wait complete. 2024-01-24T12:44:40.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:41.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.086+0000 7f3bc5312640 1 Processor -- start 2024-01-24T12:44:41.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.086+0000 7f3bc5312640 1 -- start start 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bc5312640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 0x7f3bc01491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bc5312640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc0151100 0x7f3bc01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bc5312640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc0071770 con 0x7f3bc00bc340 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bc5312640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc01496f0 con 0x7f3bc0151100 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bc5312640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc0142f20 con 0x7f3bc0148d60 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc0151100 0x7f3bc01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3bc0151100 0x7f3bc01534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39920/0 (socket says 172.21.15.27:39920) 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 -- 172.21.15.27:0/4154794408 learned_addr learned my addr 172.21.15.27:0/4154794408 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:41.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbe7fc640 1 --2- 172.21.15.27:0/4154794408 >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 0x7f3bc01491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 -- 172.21.15.27:0/4154794408 >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 msgr2=0x7f3bc01491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 --2- 172.21.15.27:0/4154794408 >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 0x7f3bc01491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 -- 172.21.15.27:0/4154794408 >> v1:172.21.15.124:6789/0 conn(0x7f3bc00bc340 legacy=0x7f3bc0142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 -- 172.21.15.27:0/4154794408 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00b37e0 con 0x7f3bc0151100 2024-01-24T12:44:41.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbe7fc640 1 --2- 172.21.15.27:0/4154794408 >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 0x7f3bc01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:41.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbf7fe640 1 --2- 172.21.15.27:0/4154794408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0151100 0x7f3bc01534f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3bc006d0c0 tx=0x7f3bb801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313913376f55aa55 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbdffb640 1 -- 172.21.15.27:0/4154794408 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80af400 con 0x7f3bc0151100 2024-01-24T12:44:41.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbdffb640 1 -- 172.21.15.27:0/4154794408 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb80ab050 con 0x7f3bc0151100 2024-01-24T12:44:41.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.090+0000 7f3bbdffb640 1 -- 172.21.15.27:0/4154794408 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80af780 con 0x7f3bc0151100 2024-01-24T12:44:41.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/4154794408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0151100 msgr2=0x7f3bc01534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- 172.21.15.27:0/4154794408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0151100 0x7f3bc01534f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3bc006d0c0 tx=0x7f3bb801f1c0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/4154794408 shutdown_connections 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- 172.21.15.27:0/4154794408 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0151100 0x7f3bc01534f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- 172.21.15.27:0/4154794408 >> v2:172.21.15.124:3300/0 conn(0x7f3bc0148d60 0x7f3bc01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/4154794408 >> 172.21.15.27:0/4154794408 conn(0x7f3bc0069ef0 msgr2=0x7f3bc006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/4154794408 shutdown_connections 2024-01-24T12:44:41.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/4154794408 wait complete. 2024-01-24T12:44:41.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 Processor -- start 2024-01-24T12:44:41.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- start start 2024-01-24T12:44:41.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 0x7f3bc0070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bc0151100 0x7f3bc0147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0070790 con 0x7f3bc0148d60 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc01e3e00 con 0x7f3bc0151100 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc01e3510 con 0x7f3bc00bc340 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39936/0 (socket says 172.21.15.27:39936) 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 -- 172.21.15.27:0/2718971486 learned_addr learned my addr 172.21.15.27:0/2718971486 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbeffd640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 0x7f3bc0070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 -- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 msgr2=0x7f3bc0070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbf7fe640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bc0151100 0x7f3bc0147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 0x7f3bc0070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 -- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bc0151100 msgr2=0x7f3bc0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bc0151100 0x7f3bc0147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 -- 172.21.15.27:0/2718971486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009b30 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbeffd640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 0x7f3bc0070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bbe7fc640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000e840 tx=0x7f3bb000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000c8d0 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000ca30 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc01e37b0 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000cde0 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc01e4290 con 0x7f3bc0148d60 2024-01-24T12:44:41.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.094+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc004e000 con 0x7f3bc0148d60 2024-01-24T12:44:41.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.098+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bb0013410 con 0x7f3bc0148d60 2024-01-24T12:44:41.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.098+0000 7f3ba77fe640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 0x7f3bac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.098+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bb0082fe0 con 0x7f3bc0148d60 2024-01-24T12:44:41.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.098+0000 7f3bbeffd640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 0x7f3bac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.098+0000 7f3bbeffd640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 0x7f3bac067f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f70 tx=0x7f3bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.102+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3bb0050910 con 0x7f3bc0148d60 2024-01-24T12:44:41.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.286+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc01e3f40 con 0x7f3bc0148d60 2024-01-24T12:44:41.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.286+0000 7f3ba77fe640 1 -- 172.21.15.27:0/2718971486 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f3bb0053f30 con 0x7f3bc0148d60 2024-01-24T12:44:41.291 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:41.291 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 msgr2=0x7f3bac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 0x7f3bac067f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f70 tx=0x7f3bb4009040 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 msgr2=0x7f3bc01dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000e840 tx=0x7f3bb000ed00 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 shutdown_connections 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3bac065a90 0x7f3bac067f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3bc0151100 0x7f3bc0147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3bc0148d60 0x7f3bc01dffc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 --2- 172.21.15.27:0/2718971486 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3bc00bc340 0x7f3bc0070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 >> 172.21.15.27:0/2718971486 conn(0x7f3bc0069ef0 msgr2=0x7f3bc00b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 shutdown_connections 2024-01-24T12:44:41.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.290+0000 7f3bc5312640 1 -- 172.21.15.27:0/2718971486 wait complete. 2024-01-24T12:44:41.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.422+0000 7f8436365640 1 Processor -- start 2024-01-24T12:44:41.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.422+0000 7f8436365640 1 -- start start 2024-01-24T12:44:41.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8436365640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f843014ea10 0x7f8430156460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8436365640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8430065f50 con 0x7f84300658e0 2024-01-24T12:44:41.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8436365640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8430071cf0 con 0x7f8430144b60 2024-01-24T12:44:41.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8436365640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8430065d70 con 0x7f843014ea10 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842f7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f84300658e0 0x7f843014e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41950/0 (socket says 172.21.15.27:41950) 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842f7fe640 1 -- 172.21.15.27:0/2993463551 learned_addr learned my addr 172.21.15.27:0/2993463551 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 --2- 172.21.15.27:0/2993463551 >> v2:172.21.15.124:3300/0 conn(0x7f843014ea10 0x7f8430156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454593593 0 0) 0x7f8420001120 con 0x7f84300658e0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8418003530 con 0x7f84300658e0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519475455 0 0) 0x7f8418003530 con 0x7f84300658e0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 >> v2:172.21.15.124:3300/0 conn(0x7f843014ea10 msgr2=0x7f8430156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 --2- 172.21.15.27:0/2993463551 >> v2:172.21.15.124:3300/0 conn(0x7f843014ea10 0x7f8430156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 >> v1:172.21.15.124:6789/0 conn(0x7f8430144b60 legacy=0x7f843006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843006af50 con 0x7f84300658e0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f8420001810 con 0x7f84300658e0 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 >> v1:172.21.15.27:6789/0 conn(0x7f84300658e0 legacy=0x7f843014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8418003980 0x7f8418003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84180047d0 0x7f8418004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 0x7f841800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430065d70 con 0x7f8418005190 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841800c030 con 0x7f84180047d0 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841800c1f0 con 0x7f8418003980 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 0x7f841800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842f7fe640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84180047d0 0x7f8418004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 -- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8418003980 msgr2=0x7f8418003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842ffff640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8418003980 0x7f8418003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8418003980 0x7f8418003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 -- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84180047d0 msgr2=0x7f8418004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84180047d0 0x7f8418004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 -- 172.21.15.27:0/2993463551 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418003530 con 0x7f8418005190 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842f7fe640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f84180047d0 0x7f8418004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:41.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f842ffff640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8418003980 0x7f8418003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:41.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 -- 172.21.15.27:0/2993463551 reap_dead start 2024-01-24T12:44:41.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.426+0000 7f8434902640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 0x7f841800b990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8428009fc0 tx=0x7f842801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1f90731e0b49c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280a5cb0 con 0x7f8418005190 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842800f040 con 0x7f8418005190 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842effd640 1 -- 172.21.15.27:0/2993463551 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428003be0 con 0x7f8418005190 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 msgr2=0x7f841800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 0x7f841800b990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8428009fc0 tx=0x7f842801cca0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/2993463551 shutdown_connections 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 --2- 172.21.15.27:0/2993463551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8418005190 0x7f841800b990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/2993463551 >> 172.21.15.27:0/2993463551 conn(0x7f8430069d20 msgr2=0x7f843006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/2993463551 shutdown_connections 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/2993463551 wait complete. 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 Processor -- start 2024-01-24T12:44:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- start start 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8418005190 0x7f84300b8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 0x7f84300bb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84300b8e60 con 0x7f84301e37d0 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843013ebb0 con 0x7f8418005190 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843013e8d0 con 0x7f8430136fb0 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39964/0 (socket says 172.21.15.27:39964) 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 -- 172.21.15.27:0/1333125077 learned_addr learned my addr 172.21.15.27:0/1333125077 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842ffff640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8418005190 0x7f84300b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8434902640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 0x7f84300bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 -- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 msgr2=0x7f84300bb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 0x7f84300bb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 -- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8418005190 msgr2=0x7f84300b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8418005190 0x7f84300b8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 -- 172.21.15.27:0/1333125077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84301e2fd0 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8434902640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 0x7f84300bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842f7fe640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f84200013a0 tx=0x7f842000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200074e0 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420007640 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84301e32b0 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200049f0 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.430+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843014c280 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843004e000 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8420004b50 con 0x7f84301e37d0 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f842cff9640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 0x7f841c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8420082c90 con 0x7f84301e37d0 2024-01-24T12:44:41.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f842ffff640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 0x7f841c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.434+0000 7f842ffff640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 0x7f841c067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8424000f70 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.438+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f84200506e0 con 0x7f84301e37d0 2024-01-24T12:44:41.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.590+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8430065f50 con 0x7f84301e37d0 2024-01-24T12:44:41.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f842cff9640 1 -- 172.21.15.27:0/1333125077 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f8430065f50 con 0x7f84301e37d0 2024-01-24T12:44:41.596 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:41.596 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 msgr2=0x7f841c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 0x7f841c067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8424000f70 tx=0x7f8424009040 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 msgr2=0x7f8430136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f84200013a0 tx=0x7f842000dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 shutdown_connections 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f841c065a60 0x7f841c067f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8430136fb0 0x7f84300bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f84301e37d0 0x7f8430136a70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 --2- 172.21.15.27:0/1333125077 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8418005190 0x7f84300b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 >> 172.21.15.27:0/1333125077 conn(0x7f8430069d20 msgr2=0x7f843013f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 shutdown_connections 2024-01-24T12:44:41.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.594+0000 7f8436365640 1 -- 172.21.15.27:0/1333125077 wait complete. 2024-01-24T12:44:41.616 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T12:44:41.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:41.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.730+0000 7fe0fdd6b640 1 Processor -- start 2024-01-24T12:44:41.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.730+0000 7fe0fdd6b640 1 -- start start 2024-01-24T12:44:41.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0fdd6b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe0f806abd0 0x7fe0f806b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0fdd6b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f80bae90 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0fdd6b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f80bc710 con 0x7fe0f80bb320 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0fdd6b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f806bc30 con 0x7fe0f806abd0 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe0f80bf9f0 0x7fe0f80b76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41966/0 (socket says 172.21.15.27:41966) 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f77fe640 1 -- 172.21.15.27:0/1337772141 learned_addr learned my addr 172.21.15.27:0/1337772141 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/1337772141 >> v2:172.21.15.124:3300/0 conn(0x7fe0f806abd0 0x7fe0f806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434215502 0 0) 0x7fe0f80bae90 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003530 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026251748 0 0) 0x7fe0e0003530 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 >> v2:172.21.15.124:3300/0 conn(0x7fe0f806abd0 msgr2=0x7fe0f806b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 --2- 172.21.15.27:0/1337772141 >> v2:172.21.15.124:3300/0 conn(0x7fe0f806abd0 0x7fe0f806b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 >> v1:172.21.15.124:6789/0 conn(0x7fe0f80bb320 legacy=0x7fe0f806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f806b670 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fe0ec001680 con 0x7fe0f80bf9f0 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 >> v1:172.21.15.27:6789/0 conn(0x7fe0f80bf9f0 legacy=0x7fe0f80b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0e0003980 0x7fe0e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 0x7fe0e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e0005190 0x7fe0e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f806bc30 con 0x7fe0e00047d0 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e000c130 con 0x7fe0e0003980 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e000c2f0 con 0x7fe0e0005190 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 0x7fe0e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0e0003980 0x7fe0e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e0005190 0x7fe0e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 -- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e0005190 msgr2=0x7fe0e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e0005190 0x7fe0e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 -- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0e0003980 msgr2=0x7fe0e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0e0003980 0x7fe0e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f6ffd640 1 -- 172.21.15.27:0/1337772141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0003530 con 0x7fe0e00047d0 2024-01-24T12:44:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0e0003980 0x7fe0e0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e0005190 0x7fe0e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.734+0000 7fe0f7fff640 1 -- 172.21.15.27:0/1337772141 reap_dead start 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f6ffd640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 0x7fe0e0004c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8001e70 tx=0x7fe0e801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14d2a013ccfabfe server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8003b80 con 0x7fe0e00047d0 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e8003ce0 con 0x7fe0e00047d0 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f67fc640 1 -- 172.21.15.27:0/1337772141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80052c0 con 0x7fe0e00047d0 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 msgr2=0x7fe0e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 0x7fe0e0004c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8001e70 tx=0x7fe0e801c740 comp rx=0 tx=0).stop 2024-01-24T12:44:41.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/1337772141 shutdown_connections 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/1337772141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0e00047d0 0x7fe0e0004c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/1337772141 >> 172.21.15.27:0/1337772141 conn(0x7fe0f80c02e0 msgr2=0x7fe0f80c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/1337772141 shutdown_connections 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/1337772141 wait complete. 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 Processor -- start 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- start start 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 0x7fe0f81e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0f80b3df0 0x7fe0f80a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80b4ad0 con 0x7fe0f81eb140 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80a5420 con 0x7fe0f80b3df0 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80b3160 con 0x7fe0e00047d0 2024-01-24T12:44:41.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39988/0 (socket says 172.21.15.27:39988) 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 -- 172.21.15.27:0/2341213498 learned_addr learned my addr 172.21.15.27:0/2341213498 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 0x7fe0f81e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f6ffd640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0f80b3df0 0x7fe0f80a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 -- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 msgr2=0x7fe0f81e87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 0x7fe0f81e87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 -- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0f80b3df0 msgr2=0x7fe0f80a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0f80b3df0 0x7fe0f80a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 -- 172.21.15.27:0/2341213498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f81e7ce0 con 0x7fe0f81eb140 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 0x7fe0f81e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0f7fff640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80c01a0 tx=0x7fe0f0010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000e840 con 0x7fe0f81eb140 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000e9a0 con 0x7fe0f81eb140 2024-01-24T12:44:41.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f81e7fc0 con 0x7fe0f81eb140 2024-01-24T12:44:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000ed10 con 0x7fe0f81eb140 2024-01-24T12:44:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.738+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f80a5940 con 0x7fe0f81eb140 2024-01-24T12:44:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f804e000 con 0x7fe0f81eb140 2024-01-24T12:44:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0f0021460 con 0x7fe0f81eb140 2024-01-24T12:44:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0dffff640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 0x7fe0e4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0f0083c30 con 0x7fe0f81eb140 2024-01-24T12:44:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 0x7fe0e4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:41.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.742+0000 7fe0f77fe640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 0x7fe0e4067f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000f70 tx=0x7fe0ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:41.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.746+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe0f0051640 con 0x7fe0f81eb140 2024-01-24T12:44:41.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.930+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f81e8470 con 0x7fe0f81eb140 2024-01-24T12:44:41.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0dffff640 1 -- 172.21.15.27:0/2341213498 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7fe0f0013370 con 0x7fe0f81eb140 2024-01-24T12:44:41.935 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:41.936 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:41.936 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 msgr2=0x7fe0e4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 0x7fe0e4067f50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000f70 tx=0x7fe0ec009040 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 msgr2=0x7fe0f81eb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80c01a0 tx=0x7fe0f0010b70 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 shutdown_connections 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe0e4065a90 0x7fe0e4067f50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0f81eb140 0x7fe0f81eb5d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe0f80b3df0 0x7fe0f80a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 --2- 172.21.15.27:0/2341213498 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe0e00047d0 0x7fe0f81e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 >> 172.21.15.27:0/2341213498 conn(0x7fe0f80c02e0 msgr2=0x7fe0f814e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:41.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 shutdown_connections 2024-01-24T12:44:41.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:41.934+0000 7fe0fdd6b640 1 -- 172.21.15.27:0/2341213498 wait complete. 2024-01-24T12:44:41.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:42.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.062+0000 7faf67228640 1 Processor -- start 2024-01-24T12:44:42.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.062+0000 7faf67228640 1 -- start start 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf67228640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60148d60 0x7faf60149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf67228640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf60151100 0x7faf601534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf67228640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf60071770 con 0x7faf600bc340 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf67228640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf60142f20 con 0x7faf60151100 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf67228640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600b37e0 con 0x7faf60148d60 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faf60151100 0x7faf601534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf64fc4640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faf600bc340 0x7faf60142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41972/0 (socket says 172.21.15.27:41972) 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf64fc4640 1 -- 172.21.15.27:0/3905146772 learned_addr learned my addr 172.21.15.27:0/3905146772 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf5ffff640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60148d60 0x7faf60149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 -- 172.21.15.27:0/3905146772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60148d60 msgr2=0x7faf60149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60148d60 0x7faf60149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 -- 172.21.15.27:0/3905146772 >> v1:172.21.15.27:6789/0 conn(0x7faf600bc340 legacy=0x7faf60142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf5f7fe640 1 -- 172.21.15.27:0/3905146772 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543876141 0 0) 0x7faf60071770 con 0x7faf600bc340 2024-01-24T12:44:42.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 -- 172.21.15.27:0/3905146772 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600b3ac0 con 0x7faf60151100 2024-01-24T12:44:42.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf657c5640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60151100 0x7faf601534f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf58009d90 tx=0x7faf5801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0052e7f8850c69 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf5f7fe640 1 -- 172.21.15.27:0/3905146772 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf580af600 con 0x7faf60151100 2024-01-24T12:44:42.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf5f7fe640 1 -- 172.21.15.27:0/3905146772 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf580ab050 con 0x7faf60151100 2024-01-24T12:44:42.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.066+0000 7faf5f7fe640 1 -- 172.21.15.27:0/3905146772 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf580af980 con 0x7faf60151100 2024-01-24T12:44:42.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/3905146772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60151100 msgr2=0x7faf601534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60151100 0x7faf601534f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf58009d90 tx=0x7faf5801f130 comp rx=0 tx=0).stop 2024-01-24T12:44:42.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/3905146772 shutdown_connections 2024-01-24T12:44:42.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60151100 0x7faf601534f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- 172.21.15.27:0/3905146772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60148d60 0x7faf60149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/3905146772 >> 172.21.15.27:0/3905146772 conn(0x7faf60069ef0 msgr2=0x7faf6006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/3905146772 shutdown_connections 2024-01-24T12:44:42.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/3905146772 wait complete. 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 Processor -- start 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- start start 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf600bc340 0x7faf600708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60151100 0x7faf601477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60147cf0 con 0x7faf60148d60 2024-01-24T12:44:42.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60070460 con 0x7faf600bc340 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006fd10 con 0x7faf60151100 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40002/0 (socket says 172.21.15.27:40002) 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 -- 172.21.15.27:0/734344469 learned_addr learned my addr 172.21.15.27:0/734344469 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf657c5640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60151100 0x7faf601477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf64fc4640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf600bc340 0x7faf600708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 -- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60151100 msgr2=0x7faf601477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60151100 0x7faf601477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 -- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf600bc340 msgr2=0x7faf600708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf600bc340 0x7faf600708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 -- 172.21.15.27:0/734344469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58009a70 con 0x7faf60148d60 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5ffff640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf4800d800 tx=0x7faf4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800b6c0 con 0x7faf60148d60 2024-01-24T12:44:42.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4800b820 con 0x7faf60148d60 2024-01-24T12:44:42.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6013ac50 con 0x7faf60148d60 2024-01-24T12:44:42.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800bb90 con 0x7faf60148d60 2024-01-24T12:44:42.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.070+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf600bbbe0 con 0x7faf60148d60 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60070610 con 0x7faf60148d60 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faf4800bcf0 con 0x7faf60148d60 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf5d7fa640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 0x7faf40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf480836e0 con 0x7faf60148d60 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf64fc4640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 0x7faf40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.074+0000 7faf64fc4640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 0x7faf40067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf50000f70 tx=0x7faf50007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.078+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7faf60070610 con 0x7faf60148d60 2024-01-24T12:44:42.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.266+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf600705d0 con 0x7faf60148d60 2024-01-24T12:44:42.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf5d7fa640 1 -- 172.21.15.27:0/734344469 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7faf48054b30 con 0x7faf60148d60 2024-01-24T12:44:42.271 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:42.271 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/1980851085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":1980851085},{"type":"v1","addr":"172.21.15.124:6835","nonce":1980851085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2915560502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2915560502},{"type":"v1","addr":"172.21.15.27:6834","nonce":2915560502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:11.284933+0000","modified":"2024-01-24T12:44:13.946696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/3678556812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":3678556812},{"type":"v1","addr":"172.21.15.27:6835","nonce":3678556812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-24T12:44:42.272 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-01-24T12:44:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 msgr2=0x7faf40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 0x7faf40067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf50000f70 tx=0x7faf50007c10 comp rx=0 tx=0).stop 2024-01-24T12:44:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 msgr2=0x7faf6013b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf4800d800 tx=0x7faf4800dcc0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 shutdown_connections 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faf40065a60 0x7faf40067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faf60151100 0x7faf601477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf60148d60 0x7faf6013b580 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 --2- 172.21.15.27:0/734344469 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faf600bc340 0x7faf600708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 >> 172.21.15.27:0/734344469 conn(0x7faf60069ef0 msgr2=0x7faf600b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 shutdown_connections 2024-01-24T12:44:42.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.270+0000 7faf67228640 1 -- 172.21.15.27:0/734344469 wait complete. 2024-01-24T12:44:42.290 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 Processor -- start 2024-01-24T12:44:42.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 -- start start 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f50d40bc340 0x7f50d4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d4142d50 0x7f50d4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d4071770 con 0x7f50d41492a0 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d41496d0 con 0x7f50d40bc340 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50da8e7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b37e0 con 0x7f50d4142d50 2024-01-24T12:44:42.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d8e84640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f50d41492a0 0x7f50d40b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41974/0 (socket says 172.21.15.27:41974) 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d8e84640 1 -- 172.21.15.27:0/1094511550 learned_addr learned my addr 172.21.15.27:0/1094511550 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d37fe640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d4142d50 0x7f50d4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d3fff640 1 --2- 172.21.15.27:0/1094511550 >> v2:172.21.15.124:3300/0 conn(0x7f50d40bc340 0x7f50d4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743288391 0 0) 0x7f50d4071770 con 0x7f50d41492a0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c0003530 con 0x7f50d41492a0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286379965 0 0) 0x7f50c0003530 con 0x7f50d41492a0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d4142d50 msgr2=0x7f50d4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d4142d50 0x7f50d4148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 >> v2:172.21.15.124:3300/0 conn(0x7f50d40bc340 msgr2=0x7f50d4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 --2- 172.21.15.27:0/1094511550 >> v2:172.21.15.124:3300/0 conn(0x7f50d40bc340 0x7f50d4142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40b3ac0 con 0x7f50d41492a0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.402+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f50cc001680 con 0x7f50d41492a0 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 >> v1:172.21.15.27:6789/0 conn(0x7f50d41492a0 legacy=0x7f50d40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50c0003980 0x7f50c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50c0005190 0x7f50c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41496d0 con 0x7f50c00047d0 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b37e0 con 0x7f50c0003980 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0004630 con 0x7f50c0005190 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d3fff640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50c0003980 0x7f50c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d8e84640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50c0005190 0x7f50c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 -- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50c0005190 msgr2=0x7f50c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50c0005190 0x7f50c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 -- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50c0003980 msgr2=0x7f50c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50c0003980 0x7f50c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 -- 172.21.15.27:0/1094511550 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0003530 con 0x7f50c00047d0 2024-01-24T12:44:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d8e84640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50c0005190 0x7f50c000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:42.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d3fff640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50c0003980 0x7f50c0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d37fe640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50c0004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009b10 tx=0x7f50bc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bcea8748a1eb54 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0a5640 con 0x7f50c00047d0 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0a57a0 con 0x7f50c00047d0 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d2ffd640 1 -- 172.21.15.27:0/1094511550 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0a5b50 con 0x7f50c00047d0 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 -- 172.21.15.27:0/1094511550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 msgr2=0x7f50c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 --2- 172.21.15.27:0/1094511550 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50c0004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009b10 tx=0x7f50bc01ca50 comp rx=0 tx=0).stop 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50d8e84640 1 -- 172.21.15.27:0/1094511550 reap_dead start 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 -- 172.21.15.27:0/1094511550 shutdown_connections 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 -- 172.21.15.27:0/1094511550 >> 172.21.15.27:0/1094511550 conn(0x7f50d4069ef0 msgr2=0x7f50d406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 -- 172.21.15.27:0/1094511550 shutdown_connections 2024-01-24T12:44:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.406+0000 7f50da8e7640 1 -- 172.21.15.27:0/1094511550 wait complete. 2024-01-24T12:44:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 Processor -- start 2024-01-24T12:44:42.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- start start 2024-01-24T12:44:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d41d0970 0x7f50d4144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50d41e0ed0 0x7f50d41e1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41d5680 con 0x7f50c00047d0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4144190 con 0x7f50d41e0ed0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40b29e0 con 0x7f50d41d0970 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40020/0 (socket says 172.21.15.27:40020) 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 -- 172.21.15.27:0/2350845992 learned_addr learned my addr 172.21.15.27:0/2350845992 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d8e84640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50d41e0ed0 0x7f50d41e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d37fe640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d41d0970 0x7f50d4144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 -- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d41d0970 msgr2=0x7f50d4144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d41d0970 0x7f50d4144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 -- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50d41e0ed0 msgr2=0x7f50d41e1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50d41e0ed0 0x7f50d41e1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 -- 172.21.15.27:0/2350845992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d41460a0 con 0x7f50c00047d0 2024-01-24T12:44:42.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d3fff640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50c400f3d0 tx=0x7f50c400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c401a070 con 0x7f50c00047d0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c40039a0 con 0x7f50c00047d0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d41443e0 con 0x7f50c00047d0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4003d10 con 0x7f50c00047d0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d41d1130 con 0x7f50c00047d0 2024-01-24T12:44:42.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d404e000 con 0x7f50c00047d0 2024-01-24T12:44:42.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50c4004020 con 0x7f50c00047d0 2024-01-24T12:44:42.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.410+0000 7f50d0ff9640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 0x7f50b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.414+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50c4084ab0 con 0x7f50c00047d0 2024-01-24T12:44:42.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.414+0000 7f50d37fe640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 0x7f50b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.414+0000 7f50d37fe640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 0x7f50b4067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.414+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f50c40525e0 con 0x7f50c00047d0 2024-01-24T12:44:42.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.570+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50d413eb10 con 0x7f50c00047d0 2024-01-24T12:44:42.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50d0ff9640 1 -- 172.21.15.27:0/2350845992 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f50c4055c00 con 0x7f50c00047d0 2024-01-24T12:44:42.576 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:42.576 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":20,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:12.287949+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:09.860199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:10.262181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 msgr2=0x7f50b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 0x7f50b4067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0046d0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 msgr2=0x7f50d41d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50c400f3d0 tx=0x7f50c400f890 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 shutdown_connections 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f50b4065a60 0x7f50b4067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f50d41e0ed0 0x7f50d41e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f50d41d0970 0x7f50d4144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 --2- 172.21.15.27:0/2350845992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50c00047d0 0x7f50d41d5140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 >> 172.21.15.27:0/2350845992 conn(0x7f50d4069ef0 msgr2=0x7f50d40b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 shutdown_connections 2024-01-24T12:44:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.574+0000 7f50da8e7640 1 -- 172.21.15.27:0/2350845992 wait complete. 2024-01-24T12:44:42.593 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-24T12:44:42.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.698+0000 7f5bc2db4640 1 Processor -- start 2024-01-24T12:44:42.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.698+0000 7f5bc2db4640 1 -- start start 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5bbc0708d0 0x7f5bbc070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5bbc071a20 0x7f5bbc147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc06eca0 0x7f5bbc147750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0b2c80 con 0x7f5bbc0708d0 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc06fdb0 con 0x7f5bbc071a20 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc070370 con 0x7f5bbc06eca0 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5bbc0708d0 0x7f5bbc070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5bbc0708d0 0x7f5bbc070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40036/0 (socket says 172.21.15.27:40036) 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 -- 172.21.15.27:0/3196715439 learned_addr learned my addr 172.21.15.27:0/3196715439 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 -- 172.21.15.27:0/3196715439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc06eca0 msgr2=0x7f5bbc147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3196715439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc06eca0 0x7f5bbc147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 -- 172.21.15.27:0/3196715439 >> v2:172.21.15.124:3300/0 conn(0x7f5bbc071a20 msgr2=0x7f5bbc147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3196715439 >> v2:172.21.15.124:3300/0 conn(0x7f5bbc071a20 0x7f5bbc147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 -- 172.21.15.27:0/3196715439 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0b2ed0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3196715439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc070cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06d230 tx=0x7f5bac01d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3971f938ed7af3b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bbb7fe640 1 -- 172.21.15.27:0/3196715439 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0aa640 con 0x7f5bbc0708d0 2024-01-24T12:44:42.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bbb7fe640 1 -- 172.21.15.27:0/3196715439 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac0aa7a0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bbb7fe640 1 -- 172.21.15.27:0/3196715439 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0aab30 con 0x7f5bbc0708d0 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3196715439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 msgr2=0x7f5bbc070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3196715439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc070cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc06d230 tx=0x7f5bac01d610 comp rx=0 tx=0).stop 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3196715439 shutdown_connections 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3196715439 >> v2:172.21.15.124:3300/0 conn(0x7f5bbc071a20 0x7f5bbc147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3196715439 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc06eca0 0x7f5bbc147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3196715439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc070cb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3196715439 >> 172.21.15.27:0/3196715439 conn(0x7f5bbc069ef0 msgr2=0x7f5bbc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3196715439 shutdown_connections 2024-01-24T12:44:42.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.702+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3196715439 wait complete. 2024-01-24T12:44:42.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 Processor -- start 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- start start 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5bbc06eca0 0x7f5bbc14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc071a20 0x7f5bbc14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0b5450 con 0x7f5bbc0708d0 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc14ec00 con 0x7f5bbc06eca0 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc14f8b0 con 0x7f5bbc071a20 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40042/0 (socket says 172.21.15.27:40042) 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 -- 172.21.15.27:0/3640798389 learned_addr learned my addr 172.21.15.27:0/3640798389 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc1351640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc071a20 0x7f5bbc14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 -- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc071a20 msgr2=0x7f5bbc14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc071a20 0x7f5bbc14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 -- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5bbc06eca0 msgr2=0x7f5bbc14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5bbc06eca0 0x7f5bbc14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5bbc06eca0 0x7f5bbc14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 -- 172.21.15.27:0/3640798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0094d0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bbbfff640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b410 tx=0x7f5bb000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0011830 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0011990 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc151470 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0011d40 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc1489e0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc04e000 con 0x7f5bbc0708d0 2024-01-24T12:44:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5bb001a400 con 0x7f5bbc0708d0 2024-01-24T12:44:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.706+0000 7f5bb97fa640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 0x7f5ba8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.710+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bb00832e0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.710+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 0x7f5ba8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.710+0000 7f5bc0b50640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 0x7f5ba8067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0af000 tx=0x7f5bac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:42.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.710+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5bb0050ca0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.894+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5bbc151190 con 0x7f5bbc0708d0 2024-01-24T12:44:42.899 INFO:tasks.ceph.mon.a.smithi027.stderr:2024-01-24T12:44:42.898+0000 7f3ce1fed640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-24T12:44:42.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.918+0000 7f5bb97fa640 1 -- 172.21.15.27:0/3640798389 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5bb00542c0 con 0x7f5bbc0708d0 2024-01-24T12:44:42.920 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 msgr2=0x7f5ba8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 0x7f5ba8067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0af000 tx=0x7f5bac008040 comp rx=0 tx=0).stop 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 msgr2=0x7f5bbc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b410 tx=0x7f5bb000b8d0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 shutdown_connections 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5ba8065a60 0x7f5ba8067f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5bbc071a20 0x7f5bbc14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bbc0708d0 0x7f5bbc0b4f10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 --2- 172.21.15.27:0/3640798389 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5bbc06eca0 0x7f5bbc14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 >> 172.21.15.27:0/3640798389 conn(0x7f5bbc069ef0 msgr2=0x7f5bbc06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 shutdown_connections 2024-01-24T12:44:42.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:42.922+0000 7f5bc2db4640 1 -- 172.21.15.27:0/3640798389 wait complete. 2024-01-24T12:44:42.925 INFO:tasks.ceph.mds.a.smithi027.stderr: -4865> 2024-01-24T12:44:12.356+0000 7f18fae87640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T12:44:42.943 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-24T12:44:42.959 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-24T12:44:43.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 Processor -- start 2024-01-24T12:44:43.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 -- start start 2024-01-24T12:44:43.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f882406db10 0x7f88240715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88240b3980 0x7f88241415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8824070360 con 0x7f8824070af0 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88240711d0 con 0x7f88240b3980 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f882a675640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882406fde0 con 0x7f882406db10 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88240b3980 0x7f88241415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f88240b3980 0x7f88241415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40074/0 (socket says 172.21.15.27:40074) 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 -- 172.21.15.27:0/30672029 learned_addr learned my addr 172.21.15.27:0/30672029 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8823fff640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f882406db10 0x7f88240715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 -- 172.21.15.27:0/30672029 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f882406db10 msgr2=0x7f88240715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f882406db10 0x7f88240715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 -- 172.21.15.27:0/30672029 >> v1:172.21.15.124:6789/0 conn(0x7f8824070af0 legacy=0x7f8824147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:43.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.050+0000 7f8828c12640 1 -- 172.21.15.27:0/30672029 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824070080 con 0x7f88240b3980 2024-01-24T12:44:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f8828c12640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88240b3980 0x7f88241415a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f881c009e50 tx=0x7f881c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727816718a344ef8 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f8822ffd640 1 -- 172.21.15.27:0/30672029 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0a5640 con 0x7f88240b3980 2024-01-24T12:44:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f8822ffd640 1 -- 172.21.15.27:0/30672029 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0a57a0 con 0x7f88240b3980 2024-01-24T12:44:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f8822ffd640 1 -- 172.21.15.27:0/30672029 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0a5b30 con 0x7f88240b3980 2024-01-24T12:44:43.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- 172.21.15.27:0/30672029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88240b3980 msgr2=0x7f88241415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:43.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88240b3980 0x7f88241415a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f881c009e50 tx=0x7f881c01c8b0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- 172.21.15.27:0/30672029 shutdown_connections 2024-01-24T12:44:43.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f88240b3980 0x7f88241415a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 --2- 172.21.15.27:0/30672029 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f882406db10 0x7f88240715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- 172.21.15.27:0/30672029 >> 172.21.15.27:0/30672029 conn(0x7f88240bcf90 msgr2=0x7f88240bd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:43.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- 172.21.15.27:0/30672029 shutdown_connections 2024-01-24T12:44:43.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- 172.21.15.27:0/30672029 wait complete. 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 Processor -- start 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.054+0000 7f882a675640 1 -- start start 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f882406db10 0x7f8824137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f88240b3980 0x7f88241e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88241379b0 con 0x7f8824070af0 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b69b0 con 0x7f882406db10 2024-01-24T12:44:43.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b6c90 con 0x7f88240b3980 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40088/0 (socket says 172.21.15.27:40088) 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 -- 172.21.15.27:0/1338717046 learned_addr learned my addr 172.21.15.27:0/1338717046 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8828c12640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f88240b3980 0x7f88241e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8823fff640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f882406db10 0x7f8824137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 -- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f88240b3980 msgr2=0x7f88241e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f88240b3980 0x7f88241e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 -- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f882406db10 msgr2=0x7f8824137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f882406db10 0x7f8824137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 -- 172.21.15.27:0/1338717046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009b30 con 0x7f8824070af0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f88237fe640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881800c450 tx=0x7f881800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818012830 con 0x7f8824070af0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88180129b0 con 0x7f8824070af0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88240b6f70 con 0x7f8824070af0 2024-01-24T12:44:43.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818012d60 con 0x7f8824070af0 2024-01-24T12:44:43.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824137f90 con 0x7f8824070af0 2024-01-24T12:44:43.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882404e000 con 0x7f8824070af0 2024-01-24T12:44:43.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f881801c460 con 0x7f8824070af0 2024-01-24T12:44:43.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 0x7f8810067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:43.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8818083000 con 0x7f8824070af0 2024-01-24T12:44:43.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.058+0000 7f8823fff640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 0x7f8810067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:43.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.062+0000 7f8823fff640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 0x7f8810067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f88140096f0 tx=0x7f8814008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:43.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.062+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8818050960 con 0x7f8824070af0 2024-01-24T12:44:43.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.250+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8824140f90 con 0x7f8824070af0 2024-01-24T12:44:43.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.918+0000 7f8820ff9640 1 -- 172.21.15.27:0/1338717046 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8818053f80 con 0x7f8824070af0 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 msgr2=0x7f8810067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 0x7f8810067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f88140096f0 tx=0x7f8814008040 comp rx=0 tx=0).stop 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 msgr2=0x7f88241e61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881800c450 tx=0x7f881800c910 comp rx=0 tx=0).stop 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 shutdown_connections 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8810065a60 0x7f8810067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f88240b3980 0x7f88241e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8824070af0 0x7f88241e61a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 --2- 172.21.15.27:0/1338717046 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f882406db10 0x7f8824137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:43.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 >> 172.21.15.27:0/1338717046 conn(0x7f88240bcf90 msgr2=0x7f88240bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:43.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 shutdown_connections 2024-01-24T12:44:43.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:43.922+0000 7f882a675640 1 -- 172.21.15.27:0/1338717046 wait complete. 2024-01-24T12:44:43.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-24T12:44:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 Processor -- start 2024-01-24T12:44:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 -- start start 2024-01-24T12:44:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5cc0b8df0 0x7fe5cc142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 0x7fe5cc148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe5cc142d80 0x7fe5cc149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc148a80 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b3890 con 0x7fe5cc142d80 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d3ce0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b3b70 con 0x7fe5cc0b8540 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5cc0b8df0 0x7fe5cc142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe5cc0b8df0 0x7fe5cc142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40104/0 (socket says 172.21.15.27:40104) 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 -- 172.21.15.27:0/2340507887 learned_addr learned my addr 172.21.15.27:0/2340507887 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d127b640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 0x7fe5cc148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 -- 172.21.15.27:0/2340507887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 msgr2=0x7fe5cc148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 0x7fe5cc148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 -- 172.21.15.27:0/2340507887 >> v2:172.21.15.124:3300/0 conn(0x7fe5cc142d80 msgr2=0x7fe5cc149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/2340507887 >> v2:172.21.15.124:3300/0 conn(0x7fe5cc142d80 0x7fe5cc149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d1a7c640 1 -- 172.21.15.27:0/2340507887 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0b3e50 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.122+0000 7fe5d127b640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 0x7fe5cc148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc0b8df0 0x7fe5cc142840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0b2a00 tx=0x7fe5c801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f26bee5b4ef80d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d0a7a640 1 -- 172.21.15.27:0/2340507887 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc071930 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d0a7a640 1 -- 172.21.15.27:0/2340507887 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80ab600 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d0a7a640 1 -- 172.21.15.27:0/2340507887 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80ab990 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/2340507887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc0b8df0 msgr2=0x7fe5cc142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:44.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc0b8df0 0x7fe5cc142840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0b2a00 tx=0x7fe5c801c520 comp rx=0 tx=0).stop 2024-01-24T12:44:44.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/2340507887 shutdown_connections 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/2340507887 >> v2:172.21.15.124:3300/0 conn(0x7fe5cc142d80 0x7fe5cc149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8540 0x7fe5cc148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/2340507887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc0b8df0 0x7fe5cc142840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/2340507887 >> 172.21.15.27:0/2340507887 conn(0x7fe5cc06a120 msgr2=0x7fe5cc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/2340507887 shutdown_connections 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/2340507887 wait complete. 2024-01-24T12:44:44.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 Processor -- start 2024-01-24T12:44:44.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.126+0000 7fe5d3ce0640 1 -- start start 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5cc0b8540 0x7fe5cc1382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 0x7fe5cc135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc138830 con 0x7fe5cc142d80 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc13b050 con 0x7fe5cc0b8540 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc13a440 con 0x7fe5cc0b8df0 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40110/0 (socket says 172.21.15.27:40110) 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 -- 172.21.15.27:0/1171325157 learned_addr learned my addr 172.21.15.27:0/1171325157 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:44.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d127b640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 0x7fe5cc135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5cc0b8540 0x7fe5cc1382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 -- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 msgr2=0x7fe5cc135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 0x7fe5cc135180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 -- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5cc0b8540 msgr2=0x7fe5cc1382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5cc0b8540 0x7fe5cc1382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 -- 172.21.15.27:0/1171325157 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80094d0 con 0x7fe5cc142d80 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d127b640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 0x7fe5cc135180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:44.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d227d640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400b9e0 tx=0x7fe5c400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:44.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c400cb20 con 0x7fe5cc142d80 2024-01-24T12:44:44.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc13a720 con 0x7fe5cc142d80 2024-01-24T12:44:44.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc13ace0 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c400cc80 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4014680 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b4005260 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5c401d3b0 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 0x7fe5b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.130+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe5c40830c0 con 0x7fe5cc142d80 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.134+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 0x7fe5b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:44.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.134+0000 7fe5d1a7c640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 0x7fe5b0067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af000 tx=0x7fe5c80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:44.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.138+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe5c4050a20 con 0x7fe5cc142d80 2024-01-24T12:44:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:44.294+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5b4005510 con 0x7fe5cc142d80 2024-01-24T12:44:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.158+0000 7fe5c27fc640 1 -- 172.21.15.27:0/1171325157 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe5c4054040 con 0x7fe5cc142d80 2024-01-24T12:44:45.159 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2024-01-24T12:44:45.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.158+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 msgr2=0x7fe5b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.158+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 0x7fe5b0067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af000 tx=0x7fe5c80a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.158+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 msgr2=0x7fe5cc1356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.158+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400b9e0 tx=0x7fe5c400bea0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 shutdown_connections 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe5b0065a60 0x7fe5b0067f20 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af000 tx=0x7fe5c80a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5cc142d80 0x7fe5cc1356c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe5cc0b8df0 0x7fe5cc135180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 --2- 172.21.15.27:0/1171325157 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe5cc0b8540 0x7fe5cc1382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.162+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 >> 172.21.15.27:0/1171325157 conn(0x7fe5cc06a120 msgr2=0x7fe5cc13fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.166+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 shutdown_connections 2024-01-24T12:44:45.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.166+0000 7fe5d3ce0640 1 -- 172.21.15.27:0/1171325157 wait complete. 2024-01-24T12:44:45.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-24T12:44:45.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 Processor -- start 2024-01-24T12:44:45.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 -- start start 2024-01-24T12:44:45.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd940b8df0 0x7efd94142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:45.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd94148a80 con 0x7efd940b8540 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd940b3890 con 0x7efd94142d80 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd9b5c8640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd940b3b70 con 0x7efd940b8df0 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd940b8df0 0x7efd94142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd940b8df0 0x7efd94142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40120/0 (socket says 172.21.15.27:40120) 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 -- 172.21.15.27:0/4022758366 learned_addr learned my addr 172.21.15.27:0/4022758366 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd98b63640 1 --1- 172.21.15.27:0/4022758366 >> v1:172.21.15.27:6789/0 conn(0x7efd940b8540 0x7efd94148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41976/0 (socket says 172.21.15.27:41976) 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 -- 172.21.15.27:0/4022758366 >> v1:172.21.15.124:6789/0 conn(0x7efd94142d80 legacy=0x7efd941531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 -- 172.21.15.27:0/4022758366 >> v1:172.21.15.27:6789/0 conn(0x7efd940b8540 legacy=0x7efd94148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd8bfff640 1 -- 172.21.15.27:0/4022758366 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711763245 0 0) 0x7efd94148a80 con 0x7efd940b8540 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.318+0000 7efd99364640 1 -- 172.21.15.27:0/4022758366 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940b3e50 con 0x7efd940b8df0 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 --2- 172.21.15.27:0/4022758366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8df0 0x7efd94142840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd90009e50 tx=0x7efd9001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4873a11f9ce10285 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd8bfff640 1 -- 172.21.15.27:0/4022758366 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94071930 con 0x7efd940b8df0 2024-01-24T12:44:45.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd8bfff640 1 -- 172.21.15.27:0/4022758366 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900a58b0 con 0x7efd940b8df0 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd8bfff640 1 -- 172.21.15.27:0/4022758366 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900a5c40 con 0x7efd940b8df0 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- 172.21.15.27:0/4022758366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8df0 msgr2=0x7efd94142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/4022758366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8df0 0x7efd94142840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd90009e50 tx=0x7efd9001c9d0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- 172.21.15.27:0/4022758366 shutdown_connections 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/4022758366 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8df0 0x7efd94142840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- 172.21.15.27:0/4022758366 >> 172.21.15.27:0/4022758366 conn(0x7efd9406a120 msgr2=0x7efd9406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- 172.21.15.27:0/4022758366 shutdown_connections 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- 172.21.15.27:0/4022758366 wait complete. 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 Processor -- start 2024-01-24T12:44:45.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- start start 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 0x7efd94145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd94142d80 0x7efd94144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94146300 con 0x7efd940b8540 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94141ac0 con 0x7efd940b8df0 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd9b5c8640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd94148100 con 0x7efd94142d80 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40134/0 (socket says 172.21.15.27:40134) 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 -- 172.21.15.27:0/2024082495 learned_addr learned my addr 172.21.15.27:0/2024082495 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 -- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd94142d80 msgr2=0x7efd94144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd94142d80 0x7efd94144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 -- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 msgr2=0x7efd94145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:45.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd98b63640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 0x7efd94145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 0x7efd94145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd99364640 1 -- 172.21.15.27:0/2024082495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009b30 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.322+0000 7efd98b63640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 0x7efd94145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd99364640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd900195e0 tx=0x7efd90019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900bd070 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900b8680 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94143310 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900b8a50 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941422a0 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9404e000 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd900b8bb0 con 0x7efd940b8540 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 0x7efd78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7efd9011e850 con 0x7efd940b8540 2024-01-24T12:44:45.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd98b63640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 0x7efd78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:45.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.326+0000 7efd98b63640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 0x7efd78067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd94143ac0 tx=0x7efd84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:45.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.330+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efd900ec580 con 0x7efd940b8540 2024-01-24T12:44:45.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:45.490+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd941544f0 con 0x7efd940b8540 2024-01-24T12:44:46.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.166+0000 7efd89ffb640 1 -- 172.21.15.27:0/2024082495 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7efd900efba0 con 0x7efd940b8540 2024-01-24T12:44:46.171 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 msgr2=0x7efd78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 0x7efd78067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd94143ac0 tx=0x7efd84009040 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 msgr2=0x7efd94141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd900195e0 tx=0x7efd90019770 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 shutdown_connections 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd78065a60 0x7efd78067f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd94142d80 0x7efd94144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd940b8df0 0x7efd94145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 --2- 172.21.15.27:0/2024082495 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd940b8540 0x7efd94141580 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd900195e0 tx=0x7efd90019770 comp rx=0 tx=0).stop 2024-01-24T12:44:46.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.170+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 >> 172.21.15.27:0/2024082495 conn(0x7efd9406a120 msgr2=0x7efd9406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:46.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.174+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 shutdown_connections 2024-01-24T12:44:46.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.174+0000 7efd9b5c8640 1 -- 172.21.15.27:0/2024082495 wait complete. 2024-01-24T12:44:46.202 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-24T12:44:46.203 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-24T12:44:46.203 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-24T12:44:46.203 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T12:44:46.203 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-24T12:44:46.203 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-24T12:44:46.203 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-24T12:44:46.204 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T12:44:46.204 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-24T12:44:46.204 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-24T12:44:46.204 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-24T12:44:46.204 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T12:44:46.215 INFO:tasks.ceph.mds.a:Stopped 2024-01-24T12:44:46.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-24T12:44:46.216 INFO:tasks.ceph.mds.b:Stopped 2024-01-24T12:44:46.216 DEBUG:teuthology.orchestra.run.smithi124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-24T12:44:46.219 INFO:tasks.ceph.mds.c:Stopped 2024-01-24T12:44:46.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-24T12:44:46.258 INFO:tasks.ceph.mds.b:Started 2024-01-24T12:44:46.259 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:46.263 INFO:tasks.ceph.mds.a:Started 2024-01-24T12:44:46.264 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:46.264 INFO:tasks.ceph.mds.c:Started 2024-01-24T12:44:46.265 DEBUG:teuthology.parallel:result is None 2024-01-24T12:44:46.265 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-24T12:44:46.327 INFO:tasks.ceph.mds.b.smithi124.stdout:starting mds.b at 2024-01-24T12:44:46.328 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-24T12:44:46.328 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-24T12:44:46.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 Processor -- start 2024-01-24T12:44:46.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 -- start start 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7a68144fc0 0x7f7a68070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6806c190 con 0x7f7a680b8f90 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6806cd10 con 0x7f7a6814b4b0 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a6d860640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a681453a0 con 0x7f7a68144fc0 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a667fc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7a680b8f90 0x7f7a6814ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41992/0 (socket says 172.21.15.27:41992) 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a667fc640 1 -- 172.21.15.27:0/3630263051 learned_addr learned my addr 172.21.15.27:0/3630263051 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a66ffd640 1 --2- 172.21.15.27:0/3630263051 >> v2:172.21.15.124:3300/0 conn(0x7f7a68144fc0 0x7f7a68070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a65ffb640 1 -- 172.21.15.27:0/3630263051 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279152500 0 0) 0x7f7a6806c190 con 0x7f7a680b8f90 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a65ffb640 1 -- 172.21.15.27:0/3630263051 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a50003530 con 0x7f7a680b8f90 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a66ffd640 1 -- 172.21.15.27:0/3630263051 >> v1:172.21.15.124:6789/0 conn(0x7f7a6814b4b0 legacy=0x7f7a68155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a66ffd640 1 -- 172.21.15.27:0/3630263051 >> v1:172.21.15.27:6789/0 conn(0x7f7a680b8f90 legacy=0x7f7a6814ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.390+0000 7f7a66ffd640 1 -- 172.21.15.27:0/3630263051 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6806ee20 con 0x7f7a68144fc0 2024-01-24T12:44:46.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a66ffd640 1 --2- 172.21.15.27:0/3630263051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a68144fc0 0x7f7a68070f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0097c0 tx=0x7f7a5c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5fa4d038ffca5c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:46.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a65ffb640 1 -- 172.21.15.27:0/3630263051 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0ab650 con 0x7f7a68144fc0 2024-01-24T12:44:46.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a65ffb640 1 -- 172.21.15.27:0/3630263051 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0ab7b0 con 0x7f7a68144fc0 2024-01-24T12:44:46.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a65ffb640 1 -- 172.21.15.27:0/3630263051 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0abb40 con 0x7f7a68144fc0 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/3630263051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a68144fc0 msgr2=0x7f7a68070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 --2- 172.21.15.27:0/3630263051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a68144fc0 0x7f7a68070f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0097c0 tx=0x7f7a5c01c450 comp rx=0 tx=0).stop 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/3630263051 shutdown_connections 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 --2- 172.21.15.27:0/3630263051 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a68144fc0 0x7f7a68070f00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/3630263051 >> 172.21.15.27:0/3630263051 conn(0x7f7a680be150 msgr2=0x7f7a680be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/3630263051 shutdown_connections 2024-01-24T12:44:46.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/3630263051 wait complete. 2024-01-24T12:44:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 Processor -- start 2024-01-24T12:44:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- start start 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a680b8f90 0x7f7a68145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a6814b4b0 0x7f7a68144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a681446b0 con 0x7f7a68144fc0 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680b6e90 con 0x7f7a680b8f90 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680b6250 con 0x7f7a6814b4b0 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40182/0 (socket says 172.21.15.27:40182) 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 -- 172.21.15.27:0/2130133703 learned_addr learned my addr 172.21.15.27:0/2130133703 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:46.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a66ffd640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a680b8f90 0x7f7a68145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a677fe640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a6814b4b0 0x7f7a68144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 -- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a6814b4b0 msgr2=0x7f7a68144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a6814b4b0 0x7f7a68144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 -- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a680b8f90 msgr2=0x7f7a68145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a680b8f90 0x7f7a68145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 -- 172.21.15.27:0/2130133703 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009420 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a667fc640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c420 tx=0x7f7a5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58005cf0 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a58005e50 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a680b6530 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580072d0 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.394+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a680b7170 con 0x7f7a68144fc0 2024-01-24T12:44:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a680b6750 con 0x7f7a68144fc0 2024-01-24T12:44:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a58007430 con 0x7f7a68144fc0 2024-01-24T12:44:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a4ffff640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 0x7f7a54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a58082350 con 0x7f7a68144fc0 2024-01-24T12:44:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a66ffd640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 0x7f7a54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:46.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.398+0000 7f7a66ffd640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 0x7f7a54067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0af000 tx=0x7f7a5c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.402+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7a580500c0 con 0x7f7a68144fc0 2024-01-24T12:44:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:46.570+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7a6806c970 con 0x7f7a68144fc0 2024-01-24T12:44:47.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.366+0000 7f7a4ffff640 1 -- 172.21.15.27:0/2130133703 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a580536e0 con 0x7f7a68144fc0 2024-01-24T12:44:47.369 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2024-01-24T12:44:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 msgr2=0x7f7a54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 0x7f7a54067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0af000 tx=0x7f7a5c0a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 msgr2=0x7f7a681e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c420 tx=0x7f7a5800c8e0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 shutdown_connections 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7a54065a60 0x7f7a54067f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7a6814b4b0 0x7f7a68144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7a68144fc0 0x7f7a681e68c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 --2- 172.21.15.27:0/2130133703 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7a680b8f90 0x7f7a68145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 >> 172.21.15.27:0/2130133703 conn(0x7f7a680be150 msgr2=0x7f7a680a2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 shutdown_connections 2024-01-24T12:44:47.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.370+0000 7f7a6d860640 1 -- 172.21.15.27:0/2130133703 wait complete. 2024-01-24T12:44:47.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-24T12:44:47.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.518+0000 7f6b318f5640 1 Processor -- start 2024-01-24T12:44:47.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.518+0000 7f6b318f5640 1 -- start start 2024-01-24T12:44:47.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0b8020 0x7f6b2c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b2c070980 0x7f6b2c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c071550 con 0x7f6b2c0bc340 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c141d00 con 0x7f6b2c070980 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c071810 con 0x7f6b2c0b8020 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b2c070980 0x7f6b2c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6b2c070980 0x7f6b2c1481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40198/0 (socket says 172.21.15.27:40198) 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 -- 172.21.15.27:0/699220537 learned_addr learned my addr 172.21.15.27:0/699220537 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2a7fc640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0b8020 0x7f6b2c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 -- 172.21.15.27:0/699220537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0b8020 msgr2=0x7f6b2c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0b8020 0x7f6b2c147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 -- 172.21.15.27:0/699220537 >> v1:172.21.15.124:6789/0 conn(0x7f6b2c0bc340 legacy=0x7f6b2c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 -- 172.21.15.27:0/699220537 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0bc720 con 0x7f6b2c070980 2024-01-24T12:44:47.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b2b7fe640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c070980 0x7f6b2c1481a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009e50 tx=0x7f6b2401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44c6c6af995822f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b29ffb640 1 -- 172.21.15.27:0/699220537 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240a5530 con 0x7f6b2c070980 2024-01-24T12:44:47.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b29ffb640 1 -- 172.21.15.27:0/699220537 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b240a5690 con 0x7f6b2c070980 2024-01-24T12:44:47.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b29ffb640 1 -- 172.21.15.27:0/699220537 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240a5a20 con 0x7f6b2c070980 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- 172.21.15.27:0/699220537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c070980 msgr2=0x7f6b2c1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c070980 0x7f6b2c1481a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009e50 tx=0x7f6b2401c980 comp rx=0 tx=0).stop 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- 172.21.15.27:0/699220537 shutdown_connections 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c070980 0x7f6b2c1481a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 --2- 172.21.15.27:0/699220537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0b8020 0x7f6b2c147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- 172.21.15.27:0/699220537 >> 172.21.15.27:0/699220537 conn(0x7f6b2c069ef0 msgr2=0x7f6b2c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- 172.21.15.27:0/699220537 shutdown_connections 2024-01-24T12:44:47.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.522+0000 7f6b318f5640 1 -- 172.21.15.27:0/699220537 wait complete. 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 Processor -- start 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- start start 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b2c070980 0x7f6b2c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 0x7f6b2c1e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c0b75d0 con 0x7f6b2c0b8020 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1e6790 con 0x7f6b2c070980 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1e6a70 con 0x7f6b2c0bc340 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40208/0 (socket says 172.21.15.27:40208) 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 -- 172.21.15.27:0/1217182232 learned_addr learned my addr 172.21.15.27:0/1217182232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2affd640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b2c070980 0x7f6b2c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2b7fe640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 0x7f6b2c1e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 -- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 msgr2=0x7f6b2c1e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 0x7f6b2c1e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 -- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b2c070980 msgr2=0x7f6b2c0b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b2c070980 0x7f6b2c0b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 -- 172.21.15.27:0/1217182232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24009b30 con 0x7f6b2c0b8020 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2b7fe640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 0x7f6b2c1e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b2a7fc640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d7d0 tx=0x7f6b2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000b6c0 con 0x7f6b2c0b8020 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000b820 con 0x7f6b2c0b8020 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c1e6d50 con 0x7f6b2c0b8020 2024-01-24T12:44:47.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000bbd0 con 0x7f6b2c0b8020 2024-01-24T12:44:47.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c1e7550 con 0x7f6b2c0b8020 2024-01-24T12:44:47.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.526+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c04e000 con 0x7f6b2c0b8020 2024-01-24T12:44:47.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.530+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b2000bd30 con 0x7f6b2c0b8020 2024-01-24T12:44:47.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.530+0000 7f6b13fff640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 0x7f6b18067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.530+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b20083360 con 0x7f6b2c0b8020 2024-01-24T12:44:47.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.530+0000 7f6b2affd640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 0x7f6b18067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.530+0000 7f6b2affd640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 0x7f6b18067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c000f70 tx=0x7f6b1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.534+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6b20051070 con 0x7f6b2c0b8020 2024-01-24T12:44:47.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.742+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6b2c06af20 con 0x7f6b2c0b8020 2024-01-24T12:44:47.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.742+0000 7f6b13fff640 1 -- 172.21.15.27:0/1217182232 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f6b20054690 con 0x7f6b2c0b8020 2024-01-24T12:44:47.746 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDhBbFlQZcTBBAAYZILl9PBM3z6f7Dlx2L6WA==", 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.747 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDhBbFlpZGZEhAAkbqCbeNGG8Mg+spl0vIeRA==", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDhBbFlyK6vDBAAvKiUTuCXvZil5TCnB5fK3w==", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-24T12:44:47.748 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDkBbFlbJT6FRAAEIkxf3AhyUYTa8joJLLDzA==", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2024-01-24T12:44:47.749 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDnBbFlC5eoHRAAaIKC5wNyh4qiMb/0NaveLA==", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDqBbFlF2c5KBAAKtOF4Th9I8UNvUGAWK7Pmg==", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.750 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDtBbFlps0WNBAAAQbOiymfE7S6UZ1H7EhGWg==", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDzBbFlPkAQNBAAXU7Vs5esWpZVQuay5eux8w==", 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.751 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQD2BbFljk0GORAAtUQKBYpFTX77NcK2tmko8g==", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.752 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQD6BbFlJsrbBRAAchLB753r6TDf7cIbQB0oiQ==", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQD9BbFlmAy1DBAA/o2LjJklZhyV4sq/aMzOMA==", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.753 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDhBbFleEe5GBAAqDGgirWGSWyzxSV0GgZeCQ==", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg==", 2024-01-24T12:44:47.754 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mds", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFlQv19OxAATZDwmZ8TUAr2h/JQHZhSrA==", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mds" 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mgr", 2024-01-24T12:44:47.755 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFljhp+OxAAfbVKLyeKXbjkyY+o32znCA==", 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-osd", 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFl2TF+OxAA08d5J0HS/LPylRCx+q8fWg==", 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-osd" 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd", 2024-01-24T12:44:47.756 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFlNUl+OxAAGPAleuw13U0PWPzBjKaMFQ==", 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFlmWF+OxAATkm7goiPM0DagnUiS+5OOQ==", 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.757 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rgw", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQACBrFlSnx+OxAA7Vhgg+4hCloyc+nXfKa70w==", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDhBbFlkNOKABAACDOB7fH6+W0UzA4iGeGz6g==", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.758 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDgBbFlM01vORAAMqmaAtMVy8lUFjfY8ZNzXw==", 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-01-24T12:44:47.759 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T12:44:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 msgr2=0x7f6b18067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 0x7f6b18067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c000f70 tx=0x7f6b1c009040 comp rx=0 tx=0).stop 2024-01-24T12:44:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 msgr2=0x7f6b2c0b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d7d0 tx=0x7f6b2000dc90 comp rx=0 tx=0).stop 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 shutdown_connections 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6b18065a90 0x7f6b18067f50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6b2c0bc340 0x7f6b2c1e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b2c0b8020 0x7f6b2c0b5ac0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 --2- 172.21.15.27:0/1217182232 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6b2c070980 0x7f6b2c0b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 >> 172.21.15.27:0/1217182232 conn(0x7f6b2c069ef0 msgr2=0x7f6b2c14b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 shutdown_connections 2024-01-24T12:44:47.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.746+0000 7f6b318f5640 1 -- 172.21.15.27:0/1217182232 wait complete. 2024-01-24T12:44:47.765 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-24T12:44:47.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 Processor -- start 2024-01-24T12:44:47.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 -- start start 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 0x7f9dc406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dc414ded0 0x7f9dc414e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc40707e0 con 0x7f9dc406f4f0 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40703c0 con 0x7f9dc414ded0 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dcbe7b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40b8750 con 0x7f9dc40bc340 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dc414ded0 0x7f9dc414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dc414ded0 0x7f9dc414e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40218/0 (socket says 172.21.15.27:40218) 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 -- 172.21.15.27:0/4294262003 learned_addr learned my addr 172.21.15.27:0/4294262003 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dc9c17640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 0x7f9dc406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 -- 172.21.15.27:0/4294262003 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 msgr2=0x7f9dc406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 0x7f9dc406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 -- 172.21.15.27:0/4294262003 >> v1:172.21.15.124:6789/0 conn(0x7f9dc406f4f0 legacy=0x7f9dc4144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dca418640 1 -- 172.21.15.27:0/4294262003 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc406fa10 con 0x7f9dc414ded0 2024-01-24T12:44:47.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.890+0000 7f9dc9c17640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 0x7f9dc406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:47.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dca418640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc414ded0 0x7f9dc414e360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009e50 tx=0x7f9dbc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa96b92a905618f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dc8c15640 1 -- 172.21.15.27:0/4294262003 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a5890 con 0x7f9dc414ded0 2024-01-24T12:44:47.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dc8c15640 1 -- 172.21.15.27:0/4294262003 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0a59f0 con 0x7f9dc414ded0 2024-01-24T12:44:47.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dc8c15640 1 -- 172.21.15.27:0/4294262003 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a5d80 con 0x7f9dc414ded0 2024-01-24T12:44:47.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/4294262003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc414ded0 msgr2=0x7f9dc414e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc414ded0 0x7f9dc414e360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009e50 tx=0x7f9dbc01c9e0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/4294262003 shutdown_connections 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc414ded0 0x7f9dc414e360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/4294262003 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc40bc340 0x7f9dc406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/4294262003 >> 172.21.15.27:0/4294262003 conn(0x7f9dc4069ef0 msgr2=0x7f9dc406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/4294262003 shutdown_connections 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.894+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/4294262003 wait complete. 2024-01-24T12:44:47.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 Processor -- start 2024-01-24T12:44:47.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- start start 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc406f4f0 0x7f9dc4137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 0x7f9dc41dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc41379d0 con 0x7f9dc40bc340 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc414d700 con 0x7f9dc414ded0 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc41e6c40 con 0x7f9dc406f4f0 2024-01-24T12:44:47.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40226/0 (socket says 172.21.15.27:40226) 2024-01-24T12:44:47.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 -- 172.21.15.27:0/2361991020 learned_addr learned my addr 172.21.15.27:0/2361991020 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:47.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9c17640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc406f4f0 0x7f9dc4137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dca418640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 0x7f9dc41dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 -- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc406f4f0 msgr2=0x7f9dc4137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc406f4f0 0x7f9dc4137490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 -- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 msgr2=0x7f9dc41dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 0x7f9dc41dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 -- 172.21.15.27:0/2361991020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009b30 con 0x7f9dc40bc340 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dca418640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 0x7f9dc41dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dc9416640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c500 tx=0x7f9db400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4005220 con 0x7f9dc40bc340 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4005380 con 0x7f9dc40bc340 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc41e6330 con 0x7f9dc40bc340 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4007270 con 0x7f9dc40bc340 2024-01-24T12:44:47.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc41e68d0 con 0x7f9dc40bc340 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc404e000 con 0x7f9dc40bc340 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.898+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9db40073d0 con 0x7f9dc40bc340 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.902+0000 7f9dba7fc640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 0x7f9da8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.902+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9db4082460 con 0x7f9dc40bc340 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.902+0000 7f9dc9c17640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 0x7f9da8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:47.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.902+0000 7f9dc9c17640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 0x7f9da8067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000d8b0 tx=0x7f9dc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:47.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:47.906+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9db4050180 con 0x7f9dc40bc340 2024-01-24T12:44:48.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.118+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9dc4155040 con 0x7f9dc40bc340 2024-01-24T12:44:48.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dba7fc640 1 -- 172.21.15.27:0/2361991020 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9db40537a0 con 0x7f9dc40bc340 2024-01-24T12:44:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 msgr2=0x7f9da8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 0x7f9da8067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000d8b0 tx=0x7f9dc0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 msgr2=0x7f9dc413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c500 tx=0x7f9db400c9c0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 shutdown_connections 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9da8065a60 0x7f9da8067f20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dc414ded0 0x7f9dc41dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dc40bc340 0x7f9dc413b7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 --2- 172.21.15.27:0/2361991020 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dc406f4f0 0x7f9dc4137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 >> 172.21.15.27:0/2361991020 conn(0x7f9dc4069ef0 msgr2=0x7f9dc413d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 shutdown_connections 2024-01-24T12:44:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.126+0000 7f9dcbe7b640 1 -- 172.21.15.27:0/2361991020 wait complete. 2024-01-24T12:44:48.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-24T12:44:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 Processor -- start 2024-01-24T12:44:48.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 -- start start 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9afc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9afc141b30 0x7f9afc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc071550 con 0x7f9afc0b8020 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc071810 con 0x7f9afc141b30 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b0264b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc071950 con 0x7f9afc0bc340 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b00be8640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9afc0b8020 0x7f9afc14abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41998/0 (socket says 172.21.15.27:41998) 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b00be8640 1 -- 172.21.15.27:0/110837798 learned_addr learned my addr 172.21.15.27:0/110837798 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/110837798 >> v2:172.21.15.124:3300/0 conn(0x7f9afc141b30 0x7f9afc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9afc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74010591 0 0) 0x7f9afc071550 con 0x7f9afc0b8020 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae4003530 con 0x7f9afc0b8020 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4381531 0 0) 0x7f9ae4003530 con 0x7f9afc0b8020 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 msgr2=0x7f9afc1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9afc1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 >> v2:172.21.15.124:3300/0 conn(0x7f9afc141b30 msgr2=0x7f9afc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 --2- 172.21.15.27:0/110837798 >> v2:172.21.15.124:3300/0 conn(0x7f9afc141b30 0x7f9afc147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0bc720 con 0x7f9afc0b8020 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f9aec001680 con 0x7f9afc0b8020 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 >> v1:172.21.15.27:6789/0 conn(0x7f9afc0b8020 legacy=0x7f9afc14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ae4003980 0x7f9ae4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae40047d0 0x7f9ae4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9ae4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc071810 con 0x7f9ae4003980 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae400b990 con 0x7f9ae40047d0 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae400bad0 con 0x7f9afc0bc340 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ae4003980 0x7f9ae4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae40047d0 0x7f9ae4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 -- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 msgr2=0x7f9ae4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b00be8640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9ae4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9ae4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 -- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae40047d0 msgr2=0x7f9ae4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae40047d0 0x7f9ae4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afbfff640 1 -- 172.21.15.27:0/110837798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae4003530 con 0x7f9ae4003980 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9b00be8640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc0bc340 0x7f9ae4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.274+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae40047d0 0x7f9ae4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9afbfff640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ae4003980 0x7f9ae4003da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9af400e170 tx=0x7f9af401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2b12d89918edb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40a5950 con 0x7f9ae4003980 2024-01-24T12:44:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af400f040 con 0x7f9ae4003980 2024-01-24T12:44:48.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9afaffd640 1 -- 172.21.15.27:0/110837798 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40a5cf0 con 0x7f9ae4003980 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- 172.21.15.27:0/110837798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ae4003980 msgr2=0x7f9ae4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 --2- 172.21.15.27:0/110837798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ae4003980 0x7f9ae4003da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9af400e170 tx=0x7f9af401cc40 comp rx=0 tx=0).stop 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b00be8640 1 -- 172.21.15.27:0/110837798 reap_dead start 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- 172.21.15.27:0/110837798 shutdown_connections 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- 172.21.15.27:0/110837798 >> 172.21.15.27:0/110837798 conn(0x7f9afc069ef0 msgr2=0x7f9afc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- 172.21.15.27:0/110837798 shutdown_connections 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- 172.21.15.27:0/110837798 wait complete. 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 Processor -- start 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.278+0000 7f9b0264b640 1 -- start start 2024-01-24T12:44:48.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae4003980 0x7f9afc144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc142db0 0x7f9afc143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc144840 con 0x7f9afc0b4c90 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc144530 con 0x7f9ae4003980 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0b50f0 con 0x7f9afc142db0 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40250/0 (socket says 172.21.15.27:40250) 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 -- 172.21.15.27:0/3249410753 learned_addr learned my addr 172.21.15.27:0/3249410753 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afbfff640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae4003980 0x7f9afc144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b00be8640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc142db0 0x7f9afc143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 -- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc142db0 msgr2=0x7f9afc143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc142db0 0x7f9afc143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 -- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae4003980 msgr2=0x7f9afc144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae4003980 0x7f9afc144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 -- 172.21.15.27:0/3249410753 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0bbb60 con 0x7f9afc0b4c90 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afb7fe640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af0010950 tx=0x7f9af0010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000ec20 con 0x7f9afc0b4c90 2024-01-24T12:44:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000ed80 con 0x7f9afc0b4c90 2024-01-24T12:44:48.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc0b4340 con 0x7f9afc0b4c90 2024-01-24T12:44:48.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0004220 con 0x7f9afc0b4c90 2024-01-24T12:44:48.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc143750 con 0x7f9afc0b4c90 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc04e000 con 0x7f9afc0b4c90 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9af0004380 con 0x7f9afc0b4c90 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 0x7f9ae8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9af0082d00 con 0x7f9afc0b4c90 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.282+0000 7f9afbfff640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 0x7f9ae8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.286+0000 7f9afbfff640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 0x7f9ae8067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9af40af000 tx=0x7f9af40a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.286+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9af0050aa0 con 0x7f9afc0b4c90 2024-01-24T12:44:48.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.502+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9afc1405a0 con 0x7f9afc0b4c90 2024-01-24T12:44:48.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.506+0000 7f9af8ff9640 1 -- 172.21.15.27:0/3249410753 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9af00540c0 con 0x7f9afc0b4c90 2024-01-24T12:44:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 msgr2=0x7f9ae8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 0x7f9ae8067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9af40af000 tx=0x7f9af40a7040 comp rx=0 tx=0).stop 2024-01-24T12:44:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 msgr2=0x7f9afc1421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9af0010950 tx=0x7f9af0010e10 comp rx=0 tx=0).stop 2024-01-24T12:44:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 shutdown_connections 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9ae8065a60 0x7f9ae8067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9afc142db0 0x7f9afc143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9afc0b4c90 0x7f9afc1421b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 --2- 172.21.15.27:0/3249410753 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ae4003980 0x7f9afc144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 >> 172.21.15.27:0/3249410753 conn(0x7f9afc069ef0 msgr2=0x7f9afc140ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 shutdown_connections 2024-01-24T12:44:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.510+0000 7f9b0264b640 1 -- 172.21.15.27:0/3249410753 wait complete. 2024-01-24T12:44:48.530 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-24T12:44:48.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 Processor -- start 2024-01-24T12:44:48.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 -- start start 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65d80bc340 0x7f65d8142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d8153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d8071770 con 0x7f65d8142d50 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80b37e0 con 0x7f65d80bc340 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65e03ef640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80b3ac0 con 0x7f65d8149470 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de18b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f65d80bc340 0x7f65d8142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65dd98a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f65d8142d50 0x7f65d8148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42002/0 (socket says 172.21.15.27:42002) 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65dd98a640 1 -- 172.21.15.27:0/1857572868 learned_addr learned my addr 172.21.15.27:0/1857572868 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:48.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de98c640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de18b640 1 -- 172.21.15.27:0/1857572868 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 msgr2=0x7f65d8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de18b640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d8153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de18b640 1 -- 172.21.15.27:0/1857572868 >> v1:172.21.15.27:6789/0 conn(0x7f65d8142d50 legacy=0x7f65d8148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65dd189640 1 -- 172.21.15.27:0/1857572868 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184999394 0 0) 0x7f65d8071770 con 0x7f65d8142d50 2024-01-24T12:44:48.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.650+0000 7f65de18b640 1 -- 172.21.15.27:0/1857572868 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80b3da0 con 0x7f65d80bc340 2024-01-24T12:44:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65de18b640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d80bc340 0x7f65d8142810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009d90 tx=0x7f65d001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf70d4c4b3b70c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65dd189640 1 -- 172.21.15.27:0/1857572868 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d00af600 con 0x7f65d80bc340 2024-01-24T12:44:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65dd189640 1 -- 172.21.15.27:0/1857572868 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d00ab050 con 0x7f65d80bc340 2024-01-24T12:44:48.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65dd189640 1 -- 172.21.15.27:0/1857572868 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d00af980 con 0x7f65d80bc340 2024-01-24T12:44:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- 172.21.15.27:0/1857572868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d80bc340 msgr2=0x7f65d8142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d80bc340 0x7f65d8142810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009d90 tx=0x7f65d001f130 comp rx=0 tx=0).stop 2024-01-24T12:44:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- 172.21.15.27:0/1857572868 shutdown_connections 2024-01-24T12:44:48.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 --2- 172.21.15.27:0/1857572868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d80bc340 0x7f65d8142810 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- 172.21.15.27:0/1857572868 >> 172.21.15.27:0/1857572868 conn(0x7f65d8069ef0 msgr2=0x7f65d806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- 172.21.15.27:0/1857572868 shutdown_connections 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- 172.21.15.27:0/1857572868 wait complete. 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 Processor -- start 2024-01-24T12:44:48.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.654+0000 7f65e03ef640 1 -- start start 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 0x7f65d81458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d81dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d813c050 con 0x7f65d8143b50 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81452f0 con 0x7f65d80bc340 2024-01-24T12:44:48.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8143140 con 0x7f65d8149470 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40262/0 (socket says 172.21.15.27:40262) 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 -- 172.21.15.27:0/245314331 learned_addr learned my addr 172.21.15.27:0/245314331 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65dd98a640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d81dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de18b640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 0x7f65d81458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 -- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 msgr2=0x7f65d81dffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d81dffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 -- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 msgr2=0x7f65d81458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 0x7f65d81458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 -- 172.21.15.27:0/245314331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0009a70 con 0x7f65d8143b50 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de18b640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 0x7f65d81458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65dd98a640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d81dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de98c640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d590 tx=0x7f65d400da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d40125f0 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4012770 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4012b20 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d8145fc0 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d8143630 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d8143850 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f65d4012c80 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 0x7f65bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65d40831d0 con 0x7f65d8143b50 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.658+0000 7f65de18b640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 0x7f65bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:48.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.662+0000 7f65de18b640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 0x7f65bc067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65d00b1000 tx=0x7f65d00aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:48.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.662+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f65d4050f70 con 0x7f65d8143b50 2024-01-24T12:44:48.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.878+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f65d804e000 con 0x7f65d8143b50 2024-01-24T12:44:48.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.882+0000 7f65ceffd640 1 -- 172.21.15.27:0/245314331 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f65d4054590 con 0x7f65d8143b50 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 msgr2=0x7f65bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 0x7f65bc067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65d00b1000 tx=0x7f65d00aa000 comp rx=0 tx=0).stop 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 msgr2=0x7f65d8144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d590 tx=0x7f65d400da50 comp rx=0 tx=0).stop 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 shutdown_connections 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f65bc065a60 0x7f65bc067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65d8143b50 0x7f65d8144980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f65d8149470 0x7f65d81dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 --2- 172.21.15.27:0/245314331 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f65d80bc340 0x7f65d81458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:48.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 >> 172.21.15.27:0/245314331 conn(0x7f65d8069ef0 msgr2=0x7f65d813fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:48.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 shutdown_connections 2024-01-24T12:44:48.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:48.886+0000 7f65e03ef640 1 -- 172.21.15.27:0/245314331 wait complete. 2024-01-24T12:44:48.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-24T12:44:49.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 Processor -- start 2024-01-24T12:44:49.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 -- start start 2024-01-24T12:44:49.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c0bc340 0x7f675c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f675c141b30 0x7f675c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c071550 con 0x7f675c0b8020 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c071810 con 0x7f675c141b30 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6762c6a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c071950 con 0x7f675c0bc340 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f675c141b30 0x7f675c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f675c141b30 0x7f675c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40272/0 (socket says 172.21.15.27:40272) 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 -- 172.21.15.27:0/4133417289 learned_addr learned my addr 172.21.15.27:0/4133417289 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f6760a06640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c0bc340 0x7f675c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 -- 172.21.15.27:0/4133417289 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c0bc340 msgr2=0x7f675c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c0bc340 0x7f675c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 -- 172.21.15.27:0/4133417289 >> v1:172.21.15.124:6789/0 conn(0x7f675c0b8020 legacy=0x7f675c14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.030+0000 7f675bfff640 1 -- 172.21.15.27:0/4133417289 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0bc720 con 0x7f675c141b30 2024-01-24T12:44:49.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f675bfff640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c141b30 0x7f675c147c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5851fe04fcb15da3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f675b7fe640 1 -- 172.21.15.27:0/4133417289 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0ab600 con 0x7f675c141b30 2024-01-24T12:44:49.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f675b7fe640 1 -- 172.21.15.27:0/4133417289 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c0a7050 con 0x7f675c141b30 2024-01-24T12:44:49.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f675b7fe640 1 -- 172.21.15.27:0/4133417289 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0ab980 con 0x7f675c141b30 2024-01-24T12:44:49.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 -- 172.21.15.27:0/4133417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c141b30 msgr2=0x7f675c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c141b30 0x7f675c147c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c01c470 comp rx=0 tx=0).stop 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 -- 172.21.15.27:0/4133417289 shutdown_connections 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c141b30 0x7f675c147c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 --2- 172.21.15.27:0/4133417289 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c0bc340 0x7f675c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 -- 172.21.15.27:0/4133417289 >> 172.21.15.27:0/4133417289 conn(0x7f675c069ef0 msgr2=0x7f675c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 -- 172.21.15.27:0/4133417289 shutdown_connections 2024-01-24T12:44:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.034+0000 7f6762c6a640 1 -- 172.21.15.27:0/4133417289 wait complete. 2024-01-24T12:44:49.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 Processor -- start 2024-01-24T12:44:49.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- start start 2024-01-24T12:44:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 0x7f675c13b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 0x7f675c13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c13d070 con 0x7f675c0bc340 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c13d700 con 0x7f675c0b8020 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c13b9e0 con 0x7f675c141b30 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40280/0 (socket says 172.21.15.27:40280) 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 -- 172.21.15.27:0/2479376835 learned_addr learned my addr 172.21.15.27:0/2479376835 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6760a06640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 0x7f675c13b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6761207640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 0x7f675c13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 -- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 msgr2=0x7f675c13db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 0x7f675c13db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 -- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 msgr2=0x7f675c13b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 0x7f675c13b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 -- 172.21.15.27:0/2479376835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0094d0 con 0x7f675c0bc340 2024-01-24T12:44:49.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6760a06640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 0x7f675c13b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6761207640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 0x7f675c13db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f675bfff640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f674c000c10 tx=0x7f674c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0b4800 con 0x7f675c0bc340 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c1485b0 con 0x7f675c0bc340 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c13bca0 con 0x7f675c0bc340 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0b4ba0 con 0x7f675c0bc340 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c13d2e0 con 0x7f675c0bc340 2024-01-24T12:44:49.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c04e000 con 0x7f675c0bc340 2024-01-24T12:44:49.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f674c0b2040 con 0x7f675c0bc340 2024-01-24T12:44:49.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.038+0000 7f67597fa640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 0x7f6748067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.042+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f674c11d1b0 con 0x7f675c0bc340 2024-01-24T12:44:49.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.042+0000 7f6760a06640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 0x7f6748067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.042+0000 7f6760a06640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 0x7f6748067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6750006fd0 tx=0x7f6750008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.046+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f674c0eaed0 con 0x7f675c0bc340 2024-01-24T12:44:49.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.254+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f675c13af00 con 0x7f675c0bc340 2024-01-24T12:44:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.258+0000 7f67597fa640 1 -- 172.21.15.27:0/2479376835 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f674c0ee4f0 con 0x7f675c0bc340 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 msgr2=0x7f6748067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 0x7f6748067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6750006fd0 tx=0x7f6750008040 comp rx=0 tx=0).stop 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 msgr2=0x7f675c139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f674c000c10 tx=0x7f674c019210 comp rx=0 tx=0).stop 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 shutdown_connections 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6748065a60 0x7f6748067f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f675c141b30 0x7f675c13db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f675c0bc340 0x7f675c139cf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 --2- 172.21.15.27:0/2479376835 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f675c0b8020 0x7f675c13b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 >> 172.21.15.27:0/2479376835 conn(0x7f675c069ef0 msgr2=0x7f675c06f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 shutdown_connections 2024-01-24T12:44:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.262+0000 7f6762c6a640 1 -- 172.21.15.27:0/2479376835 wait complete. 2024-01-24T12:44:49.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-24T12:44:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 Processor -- start 2024-01-24T12:44:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 -- start start 2024-01-24T12:44:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f49a4149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a4071770 con 0x7f49a40bc340 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a4142f20 con 0x7f49a4151100 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a8fac640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40b37e0 con 0x7f49a4148d60 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a259c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f49a40bc340 0x7f49a4142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42016/0 (socket says 172.21.15.27:42016) 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a259c640 1 -- 172.21.15.27:0/3962426317 learned_addr learned my addr 172.21.15.27:0/3962426317 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f49a4149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610102609 0 0) 0x7f49a4071770 con 0x7f49a40bc340 2024-01-24T12:44:49.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c003530 con 0x7f49a40bc340 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176273116 0 0) 0x7f498c003530 con 0x7f49a40bc340 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 msgr2=0x7f49a4149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f49a4149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 >> v1:172.21.15.124:6789/0 conn(0x7f49a4151100 legacy=0x7f49a41534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40b3ac0 con 0x7f49a40bc340 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f4994001680 con 0x7f49a40bc340 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 >> v1:172.21.15.27:6789/0 conn(0x7f49a40bc340 legacy=0x7f49a4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498c0039b0 0x7f498c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f498c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f498c005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40b37e0 con 0x7f498c004360 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c00b990 con 0x7f498c0039b0 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c00bb50 con 0x7f49a4148d60 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f498c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.402+0000 7f49a259c640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498c0039b0 0x7f498c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a2d9d640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f498c005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 -- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 msgr2=0x7f498c005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4148d60 0x7f498c005090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 -- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498c0039b0 msgr2=0x7f498c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f498c0039b0 0x7f498c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 -- 172.21.15.27:0/3962426317 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c003530 con 0x7f498c004360 2024-01-24T12:44:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f498c004830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4998009ae0 tx=0x7f499801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5099f7ee17cefa server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a5530 con 0x7f498c004360 2024-01-24T12:44:49.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49980a5690 con 0x7f498c004360 2024-01-24T12:44:49.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a159a640 1 -- 172.21.15.27:0/3962426317 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980a5a40 con 0x7f498c004360 2024-01-24T12:44:49.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 -- 172.21.15.27:0/3962426317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 msgr2=0x7f498c004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3962426317 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f498c004830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4998009ae0 tx=0x7f499801ca50 comp rx=0 tx=0).stop 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a2d9d640 1 -- 172.21.15.27:0/3962426317 reap_dead start 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 -- 172.21.15.27:0/3962426317 shutdown_connections 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 -- 172.21.15.27:0/3962426317 >> 172.21.15.27:0/3962426317 conn(0x7f49a4069ef0 msgr2=0x7f49a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 -- 172.21.15.27:0/3962426317 shutdown_connections 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.406+0000 7f49a8fac640 1 -- 172.21.15.27:0/3962426317 wait complete. 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 Processor -- start 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- start start 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4140940 0x7f49a41de590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49a4138e80 0x7f49a4145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4140dc0 con 0x7f498c004360 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41482b0 con 0x7f49a4138e80 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41ddab0 con 0x7f49a4140940 2024-01-24T12:44:49.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40302/0 (socket says 172.21.15.27:40302) 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 -- 172.21.15.27:0/3953901181 learned_addr learned my addr 172.21.15.27:0/3953901181 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a2d9d640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49a4138e80 0x7f49a4145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4140940 0x7f49a41de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 -- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4140940 msgr2=0x7f49a41de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4140940 0x7f49a41de590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 -- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49a4138e80 msgr2=0x7f49a4145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49a4138e80 0x7f49a4145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 -- 172.21.15.27:0/3953901181 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a41ddd90 con 0x7f498c004360 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a259c640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4994001060 tx=0x7f4994011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499401a030 con 0x7f498c004360 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499400fc40 con 0x7f498c004360 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994015410 con 0x7f498c004360 2024-01-24T12:44:49.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a41de070 con 0x7f498c004360 2024-01-24T12:44:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a4139750 con 0x7f498c004360 2024-01-24T12:44:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.410+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a404e000 con 0x7f498c004360 2024-01-24T12:44:49.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.414+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f499401d070 con 0x7f498c004360 2024-01-24T12:44:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.414+0000 7f4992ffd640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 0x7f4984067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.414+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f499401b070 con 0x7f498c004360 2024-01-24T12:44:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.414+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 0x7f4984067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.414+0000 7f49a1d9b640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 0x7f4984067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4998009ae0 tx=0x7f49980046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.418+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4994053b70 con 0x7f498c004360 2024-01-24T12:44:49.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.634+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f49a41485f0 con 0x7f498c004360 2024-01-24T12:44:49.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.642+0000 7f4992ffd640 1 -- 172.21.15.27:0/3953901181 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4994057190 con 0x7f498c004360 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 msgr2=0x7f4984067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 0x7f4984067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4998009ae0 tx=0x7f49980046d0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 msgr2=0x7f49a4147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4994001060 tx=0x7f4994011de0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 shutdown_connections 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4984065a90 0x7f4984067f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f49a4138e80 0x7f49a4145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f49a4140940 0x7f49a41de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 --2- 172.21.15.27:0/3953901181 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f498c004360 0x7f49a4147c90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 >> 172.21.15.27:0/3953901181 conn(0x7f49a4069ef0 msgr2=0x7f49a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:49.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 shutdown_connections 2024-01-24T12:44:49.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.646+0000 7f49a8fac640 1 -- 172.21.15.27:0/3953901181 wait complete. 2024-01-24T12:44:49.666 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-24T12:44:49.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 Processor -- start 2024-01-24T12:44:49.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 -- start start 2024-01-24T12:44:49.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f595c14b540 0x7f595c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c06cdc0 con 0x7f595c144ea0 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c071610 con 0x7f595c0b8ad0 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f5960dde640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c06ee40 con 0x7f595c14b540 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f595ad9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f595c14b540 0x7f595c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f595a59c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f595c144ea0 0x7f595c070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42026/0 (socket says 172.21.15.27:42026) 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.782+0000 7f595a59c640 1 -- 172.21.15.27:0/477204735 learned_addr learned my addr 172.21.15.27:0/477204735 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595ad9d640 1 -- 172.21.15.27:0/477204735 >> v1:172.21.15.124:6789/0 conn(0x7f595c0b8ad0 legacy=0x7f595c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595ad9d640 1 -- 172.21.15.27:0/477204735 >> v1:172.21.15.27:6789/0 conn(0x7f595c144ea0 legacy=0x7f595c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595ad9d640 1 -- 172.21.15.27:0/477204735 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c06c490 con 0x7f595c14b540 2024-01-24T12:44:49.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595959a640 1 -- 172.21.15.27:0/477204735 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700976071 0 0) 0x7f595c06cdc0 con 0x7f595c144ea0 2024-01-24T12:44:49.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595ad9d640 1 --2- 172.21.15.27:0/477204735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c14b540 0x7f595c1564f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5954009d90 tx=0x7f595401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ea0e963920ff47 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595959a640 1 -- 172.21.15.27:0/477204735 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540af600 con 0x7f595c14b540 2024-01-24T12:44:49.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595959a640 1 -- 172.21.15.27:0/477204735 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540ab050 con 0x7f595c14b540 2024-01-24T12:44:49.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f595959a640 1 -- 172.21.15.27:0/477204735 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540af980 con 0x7f595c14b540 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 -- 172.21.15.27:0/477204735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c14b540 msgr2=0x7f595c1564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 --2- 172.21.15.27:0/477204735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c14b540 0x7f595c1564f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5954009d90 tx=0x7f595401f130 comp rx=0 tx=0).stop 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 -- 172.21.15.27:0/477204735 shutdown_connections 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 --2- 172.21.15.27:0/477204735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c14b540 0x7f595c1564f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 -- 172.21.15.27:0/477204735 >> 172.21.15.27:0/477204735 conn(0x7f595c0be150 msgr2=0x7f595c0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 -- 172.21.15.27:0/477204735 shutdown_connections 2024-01-24T12:44:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.786+0000 7f5960dde640 1 -- 172.21.15.27:0/477204735 wait complete. 2024-01-24T12:44:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 Processor -- start 2024-01-24T12:44:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- start start 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f595c0b8ad0 0x7f595c0a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f595c14b540 0x7f595c1e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c14aa50 con 0x7f595c144ea0 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0b4f70 con 0x7f595c0b8ad0 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c149e80 con 0x7f595c14b540 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40322/0 (socket says 172.21.15.27:40322) 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 -- 172.21.15.27:0/2118744369 learned_addr learned my addr 172.21.15.27:0/2118744369 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f595a59c640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f595c0b8ad0 0x7f595c0a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 -- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f595c14b540 msgr2=0x7f595c1e3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f595ad9d640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f595c14b540 0x7f595c1e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f595c14b540 0x7f595c1e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 -- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f595c0b8ad0 msgr2=0x7f595c0a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f595c0b8ad0 0x7f595c0a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 -- 172.21.15.27:0/2118744369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009a70 con 0x7f595c144ea0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5959d9b640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f595000c500 tx=0x7f595000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950005220 con 0x7f595c144ea0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950005380 con 0x7f595c144ea0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c14a0b0 con 0x7f595c144ea0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950007270 con 0x7f595c144ea0 2024-01-24T12:44:49.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c14a670 con 0x7f595c144ea0 2024-01-24T12:44:49.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c071a20 con 0x7f595c144ea0 2024-01-24T12:44:49.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59500073d0 con 0x7f595c144ea0 2024-01-24T12:44:49.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 0x7f593c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:49.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.790+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5950082760 con 0x7f595c144ea0 2024-01-24T12:44:49.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.794+0000 7f595a59c640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 0x7f593c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:49.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.794+0000 7f595a59c640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 0x7f593c067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f594c000f70 tx=0x7f594c007bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:49.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:49.794+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5950050480 con 0x7f595c144ea0 2024-01-24T12:44:50.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.010+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f595c04e000 con 0x7f595c144ea0 2024-01-24T12:44:50.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f594affd640 1 -- 172.21.15.27:0/2118744369 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5950053aa0 con 0x7f595c144ea0 2024-01-24T12:44:50.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 msgr2=0x7f593c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 0x7f593c067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f594c000f70 tx=0x7f594c007bc0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 msgr2=0x7f595c0b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f595000c500 tx=0x7f595000c9c0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 shutdown_connections 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f593c065a60 0x7f593c067f20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f595c14b540 0x7f595c1e3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f595c144ea0 0x7f595c0b4a30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 --2- 172.21.15.27:0/2118744369 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f595c0b8ad0 0x7f595c0a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 >> 172.21.15.27:0/2118744369 conn(0x7f595c0be150 msgr2=0x7f595c06d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 shutdown_connections 2024-01-24T12:44:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.018+0000 7f5960dde640 1 -- 172.21.15.27:0/2118744369 wait complete. 2024-01-24T12:44:50.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:50.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.170+0000 7f22968aa640 1 Processor -- start 2024-01-24T12:44:50.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.170+0000 7f22968aa640 1 -- start start 2024-01-24T12:44:50.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f22900b81c0 0x7f229006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900b3f60 con 0x7f2290069d20 2024-01-24T12:44:50.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900702c0 con 0x7f22900b3b10 2024-01-24T12:44:50.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900b8650 con 0x7f22900b81c0 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2290069d20 0x7f229014a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42042/0 (socket says 172.21.15.27:42042) 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228ffff640 1 -- 172.21.15.27:0/3398929488 learned_addr learned my addr 172.21.15.27:0/3398929488 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228f7fe640 1 --2- 172.21.15.27:0/3398929488 >> v2:172.21.15.27:3300/0 conn(0x7f22900b81c0 0x7f229006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228effd640 1 -- 172.21.15.27:0/3398929488 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762781778 0 0) 0x7f22900b3f60 con 0x7f2290069d20 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228effd640 1 -- 172.21.15.27:0/3398929488 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227c003530 con 0x7f2290069d20 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228f7fe640 1 -- 172.21.15.27:0/3398929488 >> v1:172.21.15.124:6789/0 conn(0x7f22900b3b10 legacy=0x7f2290155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228f7fe640 1 -- 172.21.15.27:0/3398929488 >> v1:172.21.15.27:6789/0 conn(0x7f2290069d20 legacy=0x7f229014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228f7fe640 1 -- 172.21.15.27:0/3398929488 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229006ff50 con 0x7f22900b81c0 2024-01-24T12:44:50.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228f7fe640 1 --2- 172.21.15.27:0/3398929488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22900b81c0 0x7f229006a100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a592beb9f4080d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228effd640 1 -- 172.21.15.27:0/3398929488 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780a8050 con 0x7f22900b81c0 2024-01-24T12:44:50.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228effd640 1 -- 172.21.15.27:0/3398929488 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780ac5f0 con 0x7f22900b81c0 2024-01-24T12:44:50.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f228effd640 1 -- 172.21.15.27:0/3398929488 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780ac980 con 0x7f22900b81c0 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- 172.21.15.27:0/3398929488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22900b81c0 msgr2=0x7f229006a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 --2- 172.21.15.27:0/3398929488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22900b81c0 0x7f229006a100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22780097c0 tx=0x7f227801c480 comp rx=0 tx=0).stop 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- 172.21.15.27:0/3398929488 shutdown_connections 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 --2- 172.21.15.27:0/3398929488 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f22900b81c0 0x7f229006a100 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- 172.21.15.27:0/3398929488 >> 172.21.15.27:0/3398929488 conn(0x7f229006ae30 msgr2=0x7f229006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- 172.21.15.27:0/3398929488 shutdown_connections 2024-01-24T12:44:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.174+0000 7f22968aa640 1 -- 172.21.15.27:0/3398929488 wait complete. 2024-01-24T12:44:50.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 Processor -- start 2024-01-24T12:44:50.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- start start 2024-01-24T12:44:50.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 0x7f22900b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22900b3b10 0x7f22901e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b6ab0 con 0x7f2290141cc0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b51b0 con 0x7f22900b3b10 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22900b4f10 con 0x7f2290069d20 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40336/0 (socket says 172.21.15.27:40336) 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 -- 172.21.15.27:0/831567257 learned_addr learned my addr 172.21.15.27:0/831567257 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228f7fe640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22900b3b10 0x7f22901e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228ffff640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 0x7f22900b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 -- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 msgr2=0x7f22900b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 0x7f22900b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 -- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22900b3b10 msgr2=0x7f22901e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22900b3b10 0x7f22901e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 -- 172.21.15.27:0/831567257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009420 con 0x7f2290141cc0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228ffff640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 0x7f22900b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f2294e47640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f228000c430 tx=0x7f228000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280005220 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280005380 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22901e3590 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280007270 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22901e42b0 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.178+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229004e000 con 0x7f2290141cc0 2024-01-24T12:44:50.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.182+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22800073d0 con 0x7f2290141cc0 2024-01-24T12:44:50.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.182+0000 7f228cff9640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 0x7f2270067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.182+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2280082450 con 0x7f2290141cc0 2024-01-24T12:44:50.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.182+0000 7f228ffff640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 0x7f2270067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.182+0000 7f228ffff640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 0x7f2270067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2288001570 tx=0x7f2288009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.186+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2280050160 con 0x7f2290141cc0 2024-01-24T12:44:50.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.342+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f229014ee50 con 0x7f2290141cc0 2024-01-24T12:44:50.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.342+0000 7f228cff9640 1 -- 172.21.15.27:0/831567257 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f2280053780 con 0x7f2290141cc0 2024-01-24T12:44:50.346 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:50.347 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":27,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:47.361651+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 msgr2=0x7f2270067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 0x7f2270067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2288001570 tx=0x7f2288009040 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 msgr2=0x7f22901439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f228000c430 tx=0x7f228000c8f0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 shutdown_connections 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2270065a60 0x7f2270067f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2290141cc0 0x7f22901439e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f22900b3b10 0x7f22901e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 --2- 172.21.15.27:0/831567257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2290069d20 0x7f22900b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 >> 172.21.15.27:0/831567257 conn(0x7f229006ae30 msgr2=0x7f22900bb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 shutdown_connections 2024-01-24T12:44:50.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.346+0000 7f22968aa640 1 -- 172.21.15.27:0/831567257 wait complete. 2024-01-24T12:44:50.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T12:44:50.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T12:44:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.474+0000 7f8e0b601640 1 Processor -- start 2024-01-24T12:44:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.474+0000 7f8e0b601640 1 -- start start 2024-01-24T12:44:50.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8e04069f80 0x7f8e0414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b9090 0x7f8e0406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f8e040b8b20 0x7f8e04144a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040707b0 con 0x7f8e04069f80 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040b8690 con 0x7f8e040b8b20 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e040704d0 con 0x7f8e040b9090 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8e04069f80 0x7f8e0414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8e04069f80 0x7f8e0414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40350/0 (socket says 172.21.15.27:40350) 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 -- 172.21.15.27:0/540381483 learned_addr learned my addr 172.21.15.27:0/540381483 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 -- 172.21.15.27:0/540381483 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b9090 msgr2=0x7f8e0406fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 --2- 172.21.15.27:0/540381483 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b9090 0x7f8e0406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 -- 172.21.15.27:0/540381483 >> v2:172.21.15.124:3300/0 conn(0x7f8e040b8b20 msgr2=0x7f8e04144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 --2- 172.21.15.27:0/540381483 >> v2:172.21.15.124:3300/0 conn(0x7f8e040b8b20 0x7f8e04144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 -- 172.21.15.27:0/540381483 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e040b8320 con 0x7f8e04069f80 2024-01-24T12:44:50.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0939d640 1 --2- 172.21.15.27:0/540381483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e04069f80 0x7f8e0414aa90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8e04148630 tx=0x7f8df401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94435fd155844aaf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8dfbfff640 1 -- 172.21.15.27:0/540381483 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40aa640 con 0x7f8e04069f80 2024-01-24T12:44:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8dfbfff640 1 -- 172.21.15.27:0/540381483 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df40aa7a0 con 0x7f8e04069f80 2024-01-24T12:44:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8dfbfff640 1 -- 172.21.15.27:0/540381483 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40aab30 con 0x7f8e04069f80 2024-01-24T12:44:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- 172.21.15.27:0/540381483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e04069f80 msgr2=0x7f8e0414aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- 172.21.15.27:0/540381483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e04069f80 0x7f8e0414aa90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8e04148630 tx=0x7f8df401c500 comp rx=0 tx=0).stop 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- 172.21.15.27:0/540381483 shutdown_connections 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- 172.21.15.27:0/540381483 >> v2:172.21.15.124:3300/0 conn(0x7f8e040b8b20 0x7f8e04144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- 172.21.15.27:0/540381483 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b9090 0x7f8e0406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 --2- 172.21.15.27:0/540381483 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e04069f80 0x7f8e0414aa90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- 172.21.15.27:0/540381483 >> 172.21.15.27:0/540381483 conn(0x7f8e040bcf70 msgr2=0x7f8e040bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.478+0000 7f8e0b601640 1 -- 172.21.15.27:0/540381483 shutdown_connections 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- 172.21.15.27:0/540381483 wait complete. 2024-01-24T12:44:50.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 Processor -- start 2024-01-24T12:44:50.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- start start 2024-01-24T12:44:50.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 0x7f8e0413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b8b20 0x7f8e0414bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0413e4f0 con 0x7f8e040b9090 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04139970 con 0x7f8e04069f80 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e040bc510 con 0x7f8e040b8b20 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40366/0 (socket says 172.21.15.27:40366) 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 -- 172.21.15.27:0/652038111 learned_addr learned my addr 172.21.15.27:0/652038111 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0939d640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 0x7f8e0413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e08b9c640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b8b20 0x7f8e0414bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 -- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b8b20 msgr2=0x7f8e0414bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b8b20 0x7f8e0414bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 -- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 msgr2=0x7f8e0413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 0x7f8e0413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 -- 172.21.15.27:0/652038111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40094d0 con 0x7f8e040b9090 2024-01-24T12:44:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0939d640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 0x7f8e0413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e09b9e640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00b970 tx=0x7f8dfc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00cb40 con 0x7f8e040b9090 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc00ccc0 con 0x7f8e040b9090 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e040bc230 con 0x7f8e040b9090 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc014680 con 0x7f8e040b9090 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0413a3a0 con 0x7f8e040b9090 2024-01-24T12:44:50.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.482+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0413a0c0 con 0x7f8e040b9090 2024-01-24T12:44:50.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.486+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8dfc01d3b0 con 0x7f8e040b9090 2024-01-24T12:44:50.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.486+0000 7f8df9ffb640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 0x7f8de8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.486+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8dfc082db0 con 0x7f8e040b9090 2024-01-24T12:44:50.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.486+0000 7f8e0939d640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 0x7f8de8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.486+0000 7f8e0939d640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 0x7f8de8067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8df40ae000 tx=0x7f8df40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.490+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f8e0413a0c0 con 0x7f8e040b9090 2024-01-24T12:44:50.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.642+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e0413a0c0 con 0x7f8e040b9090 2024-01-24T12:44:50.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8df9ffb640 1 -- 172.21.15.27:0/652038111 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e0413a0c0 con 0x7f8e040b9090 2024-01-24T12:44:50.648 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 msgr2=0x7f8de8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 0x7f8de8067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8df40ae000 tx=0x7f8df40a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 msgr2=0x7f8e041498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00b970 tx=0x7f8dfc00be30 comp rx=0 tx=0).stop 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 shutdown_connections 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8de8065a60 0x7f8de8067f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8e040b9090 0x7f8e041498e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f8e040b8b20 0x7f8e0414bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 --2- 172.21.15.27:0/652038111 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f8e04069f80 0x7f8e0413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 >> 172.21.15.27:0/652038111 conn(0x7f8e040bcf70 msgr2=0x7f8e0413b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 shutdown_connections 2024-01-24T12:44:50.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.646+0000 7f8e0b601640 1 -- 172.21.15.27:0/652038111 wait complete. 2024-01-24T12:44:50.665 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T12:44:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.770+0000 7f3875491640 1 Processor -- start 2024-01-24T12:44:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.770+0000 7f3875491640 1 -- start start 2024-01-24T12:44:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f3875491640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f387014b540 0x7f38700bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f3875491640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f3875491640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387006ad50 con 0x7f387006a4c0 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f3875491640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38700bc320 con 0x7f387014b540 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f3875491640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38700bb650 con 0x7f387006a900 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386effd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f387014b540 0x7f38700bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:46708/0 (socket says 172.21.15.27:46708) 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386e7fc640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f387006a4c0 0x7f387014dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:38466/0 (socket says 172.21.15.27:38466) 2024-01-24T12:44:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 -- 172.21.15.27:0/3840614257 learned_addr learned my addr 172.21.15.27:0/3840614257 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 -- 172.21.15.27:0/3840614257 >> v2:172.21.15.124:3300/0 conn(0x7f387014b540 msgr2=0x7f38700bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 --2- 172.21.15.27:0/3840614257 >> v2:172.21.15.124:3300/0 conn(0x7f387014b540 0x7f38700bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 -- 172.21.15.27:0/3840614257 >> v1:172.21.15.124:6789/0 conn(0x7f387006a4c0 legacy=0x7f387014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 -- 172.21.15.27:0/3840614257 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38700bc590 con 0x7f387006a900 2024-01-24T12:44:50.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.774+0000 7f386f7fe640 1 --2- 172.21.15.27:0/3840614257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3868009e50 tx=0x7f386801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fde1b0ebe0d9636 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386dffb640 1 -- 172.21.15.27:0/3840614257 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680af400 con 0x7f387006a900 2024-01-24T12:44:50.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386dffb640 1 -- 172.21.15.27:0/3840614257 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680ab050 con 0x7f387006a900 2024-01-24T12:44:50.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386dffb640 1 -- 172.21.15.27:0/3840614257 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680af780 con 0x7f387006a900 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/3840614257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 msgr2=0x7f387014e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- 172.21.15.27:0/3840614257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3868009e50 tx=0x7f386801f1f0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/3840614257 shutdown_connections 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- 172.21.15.27:0/3840614257 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387006a900 0x7f387014e6e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- 172.21.15.27:0/3840614257 >> v2:172.21.15.124:3300/0 conn(0x7f387014b540 0x7f38700bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/3840614257 >> 172.21.15.27:0/3840614257 conn(0x7f38700c02e0 msgr2=0x7f38700c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/3840614257 shutdown_connections 2024-01-24T12:44:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/3840614257 wait complete. 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 Processor -- start 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- start start 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f387006a900 0x7f3870147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387014b540 0x7f38700b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3870145ab0 con 0x7f387006a4c0 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3870146cc0 con 0x7f387006a900 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3870144ea0 con 0x7f387014b540 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40376/0 (socket says 172.21.15.27:40376) 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 -- 172.21.15.27:0/4162489537 learned_addr learned my addr 172.21.15.27:0/4162489537 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386e7fc640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f387006a900 0x7f3870147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386f7fe640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387014b540 0x7f38700b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 -- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387014b540 msgr2=0x7f38700b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387014b540 0x7f38700b94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 -- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f387006a900 msgr2=0x7f3870147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f387006a900 0x7f3870147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 -- 172.21.15.27:0/4162489537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009b30 con 0x7f387006a4c0 2024-01-24T12:44:50.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f386effd640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f386000e930 tx=0x7f386000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860009690 con 0x7f387006a4c0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386000ca00 con 0x7f387006a4c0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3870145180 con 0x7f387006a4c0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386000cd70 con 0x7f387006a4c0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.778+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3870145740 con 0x7f387006a4c0 2024-01-24T12:44:50.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387004e000 con 0x7f387006a4c0 2024-01-24T12:44:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3860013470 con 0x7f387006a4c0 2024-01-24T12:44:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f38677fe640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 0x7f3850067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3860083960 con 0x7f387006a4c0 2024-01-24T12:44:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f386e7fc640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 0x7f3850067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.782+0000 7f386e7fc640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 0x7f3850067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f38701480a0 tx=0x7f3858007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:50.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.786+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3860051710 con 0x7f387006a4c0 2024-01-24T12:44:50.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38700a6260 con 0x7f387006a4c0 2024-01-24T12:44:50.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f38677fe640 1 -- 172.21.15.27:0/4162489537 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3860017060 con 0x7f387006a4c0 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-24T12:44:50.940 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 msgr2=0x7f3850067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 0x7f3850067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f38701480a0 tx=0x7f3858007cf0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 msgr2=0x7f3870146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f386000e930 tx=0x7f386000edf0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 shutdown_connections 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3850065a60 0x7f3850067f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f387014b540 0x7f38700b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f387006a900 0x7f3870147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 --2- 172.21.15.27:0/4162489537 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f387006a4c0 0x7f3870146640 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 >> 172.21.15.27:0/4162489537 conn(0x7f38700c02e0 msgr2=0x7f3870148d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 shutdown_connections 2024-01-24T12:44:50.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:50.938+0000 7f3875491640 1 -- 172.21.15.27:0/4162489537 wait complete. 2024-01-24T12:44:50.957 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T12:44:50.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T12:44:51.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 Processor -- start 2024-01-24T12:44:51.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 -- start start 2024-01-24T12:44:51.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dd806af90 0x7f9dd8148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f9dd81458f0 0x7f9dd8145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd8071850 con 0x7f9dd814be30 2024-01-24T12:44:51.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80b53f0 con 0x7f9dd806af90 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dde609640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80b4720 con 0x7f9dd81458f0 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dd806af90 0x7f9dd8148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9dd806af90 0x7f9dd8148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50290/0 (socket says 172.21.15.27:50290) 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 -- 172.21.15.27:0/1171237762 learned_addr learned my addr 172.21.15.27:0/1171237762 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 -- 172.21.15.27:0/1171237762 >> v2:172.21.15.124:3300/0 conn(0x7f9dd81458f0 msgr2=0x7f9dd8145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 --2- 172.21.15.27:0/1171237762 >> v2:172.21.15.124:3300/0 conn(0x7f9dd81458f0 0x7f9dd8145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 -- 172.21.15.27:0/1171237762 >> v1:172.21.15.124:6789/0 conn(0x7f9dd814be30 legacy=0x7f9dd814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:51.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.070+0000 7f9dd7fff640 1 -- 172.21.15.27:0/1171237762 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80b8950 con 0x7f9dd806af90 2024-01-24T12:44:51.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd7fff640 1 --2- 172.21.15.27:0/1171237762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd806af90 0x7f9dd8148900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9dd806f1c0 tx=0x7f9dd001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274ad00a2415ec7e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd6ffd640 1 -- 172.21.15.27:0/1171237762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00ac410 con 0x7f9dd806af90 2024-01-24T12:44:51.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd6ffd640 1 -- 172.21.15.27:0/1171237762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd00ac570 con 0x7f9dd806af90 2024-01-24T12:44:51.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd6ffd640 1 -- 172.21.15.27:0/1171237762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00ac900 con 0x7f9dd806af90 2024-01-24T12:44:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- 172.21.15.27:0/1171237762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd806af90 msgr2=0x7f9dd8148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- 172.21.15.27:0/1171237762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd806af90 0x7f9dd8148900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9dd806f1c0 tx=0x7f9dd001c4c0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- 172.21.15.27:0/1171237762 shutdown_connections 2024-01-24T12:44:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- 172.21.15.27:0/1171237762 >> v2:172.21.15.124:3300/0 conn(0x7f9dd81458f0 0x7f9dd8145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- 172.21.15.27:0/1171237762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd806af90 0x7f9dd8148900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- 172.21.15.27:0/1171237762 >> 172.21.15.27:0/1171237762 conn(0x7f9dd80b9140 msgr2=0x7f9dd80b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- 172.21.15.27:0/1171237762 shutdown_connections 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- 172.21.15.27:0/1171237762 wait complete. 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 Processor -- start 2024-01-24T12:44:51.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- start start 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dd806af90 0x7f9dd8147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dd81458f0 0x7f9dd813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd813f330 con 0x7f9dd814be30 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81e4450 con 0x7f9dd81458f0 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dde609640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81e0cc0 con 0x7f9dd806af90 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50298/0 (socket says 172.21.15.27:50298) 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 -- 172.21.15.27:0/4175835933 learned_addr learned my addr 172.21.15.27:0/4175835933 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd77fe640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dd81458f0 0x7f9dd813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9dd7fff640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dd806af90 0x7f9dd8147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 -- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dd806af90 msgr2=0x7f9dd8147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dd806af90 0x7f9dd8147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 -- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dd81458f0 msgr2=0x7f9dd813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dd81458f0 0x7f9dd813edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.074+0000 7f9ddcba6640 1 -- 172.21.15.27:0/4175835933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00094d0 con 0x7f9dd814be30 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9ddcba6640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b9c0 tx=0x7f9dc800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800cba0 con 0x7f9dd814be30 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc800cd00 con 0x7f9dd814be30 2024-01-24T12:44:51.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8148440 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8014680 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd81e40e0 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd81e45e0 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9dc801d3b0 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 0x7f9dc4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9dc8082df0 con 0x7f9dd814be30 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd7fff640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 0x7f9dc4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.078+0000 7f9dd7fff640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 0x7f9dc4067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00ae000 tx=0x7f9dd00a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.082+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9dc8050af0 con 0x7f9dd814be30 2024-01-24T12:44:51.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.234+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9dd804e000 con 0x7f9dd814be30 2024-01-24T12:44:51.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.386+0000 7f9dd4ff9640 1 -- 172.21.15.27:0/4175835933 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9dc8019020 con 0x7f9dd814be30 2024-01-24T12:44:51.389 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-01-24T12:44:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 msgr2=0x7f9dc4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 0x7f9dc4067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00ae000 tx=0x7f9dd00a6040 comp rx=0 tx=0).stop 2024-01-24T12:44:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 msgr2=0x7f9dd81e0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800b9c0 tx=0x7f9dc800be80 comp rx=0 tx=0).stop 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 shutdown_connections 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9dc4065a60 0x7f9dc4067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9dd814be30 0x7f9dd81e0780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9dd81458f0 0x7f9dd813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 --2- 172.21.15.27:0/4175835933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9dd806af90 0x7f9dd8147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.390+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 >> 172.21.15.27:0/4175835933 conn(0x7f9dd80b9140 msgr2=0x7f9dd814c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.394+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 shutdown_connections 2024-01-24T12:44:51.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.394+0000 7f9dde609640 1 -- 172.21.15.27:0/4175835933 wait complete. 2024-01-24T12:44:51.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T12:44:51.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 Processor -- start 2024-01-24T12:44:51.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 -- start start 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e00b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f34e00b8ba0 0x7f34e01552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e014ef10 con 0x7f34e006d8b0 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e00b8240 con 0x7f34e00b8ba0 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e6460640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e0070020 con 0x7f34e006dc90 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e49fd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f34e00b8ba0 0x7f34e01552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34dffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f34e006d8b0 0x7f34e00b3b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60084/0 (socket says 172.21.15.27:60084) 2024-01-24T12:44:51.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34dffff640 1 -- 172.21.15.27:0/2079542952 learned_addr learned my addr 172.21.15.27:0/2079542952 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e49fd640 1 -- 172.21.15.27:0/2079542952 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 msgr2=0x7f34e00b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34df7fe640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e00b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e49fd640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e00b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e49fd640 1 -- 172.21.15.27:0/2079542952 >> v1:172.21.15.27:6789/0 conn(0x7f34e006d8b0 legacy=0x7f34e00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34deffd640 1 -- 172.21.15.27:0/2079542952 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055631404 0 0) 0x7f34e014ef10 con 0x7f34e006d8b0 2024-01-24T12:44:51.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.542+0000 7f34e49fd640 1 -- 172.21.15.27:0/2079542952 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e014dfb0 con 0x7f34e00b8ba0 2024-01-24T12:44:51.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e01552e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d90 tx=0x7f34d801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884320bb3d297e5e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34deffd640 1 -- 172.21.15.27:0/2079542952 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80a58f0 con 0x7f34e00b8ba0 2024-01-24T12:44:51.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34deffd640 1 -- 172.21.15.27:0/2079542952 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d80a5a50 con 0x7f34e00b8ba0 2024-01-24T12:44:51.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34deffd640 1 -- 172.21.15.27:0/2079542952 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80a5de0 con 0x7f34e00b8ba0 2024-01-24T12:44:51.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- 172.21.15.27:0/2079542952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 msgr2=0x7f34e01552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e01552e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d90 tx=0x7f34d801c920 comp rx=0 tx=0).stop 2024-01-24T12:44:51.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- 172.21.15.27:0/2079542952 shutdown_connections 2024-01-24T12:44:51.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e01552e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- 172.21.15.27:0/2079542952 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e00b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- 172.21.15.27:0/2079542952 >> 172.21.15.27:0/2079542952 conn(0x7f34e00bcf90 msgr2=0x7f34e00bd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- 172.21.15.27:0/2079542952 shutdown_connections 2024-01-24T12:44:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- 172.21.15.27:0/2079542952 wait complete. 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 Processor -- start 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- start start 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34e006d8b0 0x7f34e013ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e0149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e0148dc0 con 0x7f34e00b8ba0 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e013ad80 con 0x7f34e006d8b0 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e6460640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e0143340 con 0x7f34e006dc90 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50320/0 (socket says 172.21.15.27:50320) 2024-01-24T12:44:51.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 -- 172.21.15.27:0/996266240 learned_addr learned my addr 172.21.15.27:0/996266240 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34dffff640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34e006d8b0 0x7f34e013ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34df7fe640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e0149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 -- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 msgr2=0x7f34e0149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e0149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 -- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34e006d8b0 msgr2=0x7f34e013ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34e006d8b0 0x7f34e013ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.546+0000 7f34e49fd640 1 -- 172.21.15.27:0/996266240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8009a70 con 0x7f34e00b8ba0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34e49fd640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d90 tx=0x7f34d80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8003ba0 con 0x7f34e00b8ba0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8003d00 con 0x7f34e00b8ba0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e014a170 con 0x7f34e00b8ba0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80ad850 con 0x7f34e00b8ba0 2024-01-24T12:44:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e0149e80 con 0x7f34e00b8ba0 2024-01-24T12:44:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e0143500 con 0x7f34e00b8ba0 2024-01-24T12:44:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34d80b4070 con 0x7f34e00b8ba0 2024-01-24T12:44:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 0x7f34cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f34d811e280 con 0x7f34e00b8ba0 2024-01-24T12:44:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dffff640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 0x7f34cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:51.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.550+0000 7f34dffff640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 0x7f34cc067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000f70 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.554+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f34d80ebf10 con 0x7f34e00b8ba0 2024-01-24T12:44:51.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:51.710+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f34e004e000 con 0x7f34e00b8ba0 2024-01-24T12:44:52.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.390+0000 7f34dcff9640 1 -- 172.21.15.27:0/996266240 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f34d80b20d0 con 0x7f34e00b8ba0 2024-01-24T12:44:52.395 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-01-24T12:44:52.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.398+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 msgr2=0x7f34cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.398+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 0x7f34cc067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000f70 tx=0x7f34d0009040 comp rx=0 tx=0).stop 2024-01-24T12:44:52.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.398+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 msgr2=0x7f34e0143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.398+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009d90 tx=0x7f34d80196c0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 shutdown_connections 2024-01-24T12:44:52.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f34cc065a60 0x7f34cc067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34e00b8ba0 0x7f34e0143820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f34e006dc90 0x7f34e0149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 --2- 172.21.15.27:0/996266240 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f34e006d8b0 0x7f34e013ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 >> 172.21.15.27:0/996266240 conn(0x7f34e00bcf90 msgr2=0x7f34e00b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:52.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 shutdown_connections 2024-01-24T12:44:52.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.402+0000 7f34e6460640 1 -- 172.21.15.27:0/996266240 wait complete. 2024-01-24T12:44:52.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T12:44:52.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.562+0000 7faa2635a640 1 Processor -- start 2024-01-24T12:44:52.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.562+0000 7faa2635a640 1 -- start start 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8df0 0x7faa20147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa20070e40 0x7faa20141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 0x7faa20141b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa200b30e0 con 0x7faa20070e40 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa200b3770 con 0x7faa200b8530 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa2635a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa20147780 con 0x7faa200b8df0 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa20070e40 0x7faa20141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa20070e40 0x7faa20141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50326/0 (socket says 172.21.15.27:50326) 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 -- 172.21.15.27:0/3917509722 learned_addr learned my addr 172.21.15.27:0/3917509722 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa248f7640 1 --2- 172.21.15.27:0/3917509722 >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 0x7faa20141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1ffff640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8df0 0x7faa20147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 -- 172.21.15.27:0/3917509722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8df0 msgr2=0x7faa20147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8df0 0x7faa20147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 -- 172.21.15.27:0/3917509722 >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 msgr2=0x7faa20141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 --2- 172.21.15.27:0/3917509722 >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 0x7faa20141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 -- 172.21.15.27:0/3917509722 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2006ec30 con 0x7faa20070e40 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa248f7640 1 --2- 172.21.15.27:0/3917509722 >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 0x7faa20141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:52.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1f7fe640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20070e40 0x7faa20141620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faa200b64e0 tx=0x7faa0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927e8a6e196caf9b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1effd640 1 -- 172.21.15.27:0/3917509722 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080ac410 con 0x7faa20070e40 2024-01-24T12:44:52.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1effd640 1 -- 172.21.15.27:0/3917509722 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa080ac570 con 0x7faa20070e40 2024-01-24T12:44:52.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.566+0000 7faa1effd640 1 -- 172.21.15.27:0/3917509722 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080ac900 con 0x7faa20070e40 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3917509722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20070e40 msgr2=0x7faa20141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20070e40 0x7faa20141620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faa200b64e0 tx=0x7faa0801c500 comp rx=0 tx=0).stop 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3917509722 shutdown_connections 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- 172.21.15.27:0/3917509722 >> v2:172.21.15.124:3300/0 conn(0x7faa200b8530 0x7faa20141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20070e40 0x7faa20141620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- 172.21.15.27:0/3917509722 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8df0 0x7faa20147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3917509722 >> 172.21.15.27:0/3917509722 conn(0x7faa2006a120 msgr2=0x7faa2006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:52.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3917509722 shutdown_connections 2024-01-24T12:44:52.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3917509722 wait complete. 2024-01-24T12:44:52.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 Processor -- start 2024-01-24T12:44:52.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- start start 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 0x7faa200bb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa200b8df0 0x7faa201e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200bbca0 con 0x7faa20134030 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa20149f90 con 0x7faa200b8df0 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2014a270 con 0x7faa200b8530 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50328/0 (socket says 172.21.15.27:50328) 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 -- 172.21.15.27:0/3589655853 learned_addr learned my addr 172.21.15.27:0/3589655853 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1ffff640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 0x7faa200bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1f7fe640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa200b8df0 0x7faa201e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 -- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 msgr2=0x7faa200bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 0x7faa200bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 -- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa200b8df0 msgr2=0x7faa201e4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa200b8df0 0x7faa201e4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 -- 172.21.15.27:0/3589655853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080094d0 con 0x7faa20134030 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1ffff640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 0x7faa200bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa248f7640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faa1000c7f0 tx=0x7faa1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10007820 con 0x7faa20134030 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa100079c0 con 0x7faa20134030 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2014a550 con 0x7faa20134030 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10007d70 con 0x7faa20134030 2024-01-24T12:44:52.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.570+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa201312b0 con 0x7faa20134030 2024-01-24T12:44:52.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2004e000 con 0x7faa20134030 2024-01-24T12:44:52.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa100113f0 con 0x7faa20134030 2024-01-24T12:44:52.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa1cff9640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 0x7faa00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7faa10083430 con 0x7faa20134030 2024-01-24T12:44:52.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa1ffff640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 0x7faa00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.574+0000 7faa1ffff640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 0x7faa00067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ed0 tx=0x7faa18007420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.578+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7faa10050ee0 con 0x7faa20134030 2024-01-24T12:44:52.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.766+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faa200b7840 con 0x7faa20134030 2024-01-24T12:44:52.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.778+0000 7faa1cff9640 1 -- 172.21.15.27:0/3589655853 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7faa10054500 con 0x7faa20134030 2024-01-24T12:44:52.781 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 4 and data pool 5 2024-01-24T12:44:52.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 msgr2=0x7faa00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 0x7faa00067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ed0 tx=0x7faa18007420 comp rx=0 tx=0).stop 2024-01-24T12:44:52.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 msgr2=0x7faa201e4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faa1000c7f0 tx=0x7faa1000ccb0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 shutdown_connections 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa00065a60 0x7faa00067f20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa20134030 0x7faa201e4840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa200b8df0 0x7faa201e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 --2- 172.21.15.27:0/3589655853 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa200b8530 0x7faa200bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.786+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 >> 172.21.15.27:0/3589655853 conn(0x7faa2006a120 msgr2=0x7faa2006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:52.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.790+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 shutdown_connections 2024-01-24T12:44:52.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.790+0000 7faa2635a640 1 -- 172.21.15.27:0/3589655853 wait complete. 2024-01-24T12:44:52.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.930+0000 7f2d85a7f640 1 Processor -- start 2024-01-24T12:44:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.930+0000 7f2d85a7f640 1 -- start start 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2d8014b540 0x7f2d800bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8014edf0 con 0x7f2d8006a900 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d800bc590 con 0x7f2d8006a4c0 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d800bc320 con 0x7f2d8014b540 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2d8014b540 0x7f2d800bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2d8006a900 0x7f2d8014e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60088/0 (socket says 172.21.15.27:60088) 2024-01-24T12:44:52.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7ffff640 1 -- 172.21.15.27:0/1796045200 learned_addr learned my addr 172.21.15.27:0/1796045200 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:52.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/1796045200 >> v1:172.21.15.124:6789/0 conn(0x7f2d8006a4c0 legacy=0x7f2d8014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:52.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/1796045200 >> v1:172.21.15.27:6789/0 conn(0x7f2d8006a900 legacy=0x7f2d8014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/1796045200 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800b3a10 con 0x7f2d8014b540 2024-01-24T12:44:52.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7f7fe640 1 --2- 172.21.15.27:0/1796045200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8014b540 0x7f2d800bac60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d7401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a886594676879bef server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7e7fc640 1 -- 172.21.15.27:0/1796045200 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740a8930 con 0x7f2d8014b540 2024-01-24T12:44:52.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7e7fc640 1 -- 172.21.15.27:0/1796045200 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740a8a90 con 0x7f2d8014b540 2024-01-24T12:44:52.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d7e7fc640 1 -- 172.21.15.27:0/1796045200 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740a8e20 con 0x7f2d8014b540 2024-01-24T12:44:52.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- 172.21.15.27:0/1796045200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8014b540 msgr2=0x7f2d800bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/1796045200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8014b540 0x7f2d800bac60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d7401ec30 comp rx=0 tx=0).stop 2024-01-24T12:44:52.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- 172.21.15.27:0/1796045200 shutdown_connections 2024-01-24T12:44:52.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/1796045200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8014b540 0x7f2d800bac60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- 172.21.15.27:0/1796045200 >> 172.21.15.27:0/1796045200 conn(0x7f2d800c02e0 msgr2=0x7f2d800c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:52.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- 172.21.15.27:0/1796045200 shutdown_connections 2024-01-24T12:44:52.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.934+0000 7f2d85a7f640 1 -- 172.21.15.27:0/1796045200 wait complete. 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 Processor -- start 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- start start 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d8006a900 0x7f2d800b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 0x7f2d800b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800ba490 con 0x7f2d8006a4c0 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800b85e0 con 0x7f2d8014b540 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800b7ac0 con 0x7f2d8006a900 2024-01-24T12:44:52.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50352/0 (socket says 172.21.15.27:50352) 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/3246205542 learned_addr learned my addr 172.21.15.27:0/3246205542 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7ffff640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 0x7f2d800b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7effd640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d8006a900 0x7f2d800b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d8006a900 msgr2=0x7f2d800b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d8006a900 0x7f2d800b8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 msgr2=0x7f2d800b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 0x7f2d800b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 -- 172.21.15.27:0/3246205542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009420 con 0x7f2d8006a4c0 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7ffff640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 0x7f2d800b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:52.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d7f7fe640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d7401b840 tx=0x7f2d7401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b9630 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740b97b0 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b9b60 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d800b7d40 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d800b8300 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8004e000 con 0x7f2d8006a4c0 2024-01-24T12:44:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.938+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d740b7040 con 0x7f2d8006a4c0 2024-01-24T12:44:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.942+0000 7f2d67fff640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 0x7f2d6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.942+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d74121120 con 0x7f2d8006a4c0 2024-01-24T12:44:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.942+0000 7f2d7effd640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 0x7f2d6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.942+0000 7f2d7effd640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 0x7f2d6c067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d800bdab0 tx=0x7f2d70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:52.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:52.946+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f2d740eeb70 con 0x7f2d8006a4c0 2024-01-24T12:44:53.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.098+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d800a6260 con 0x7f2d8006a4c0 2024-01-24T12:44:53.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d67fff640 1 -- 172.21.15.27:0/3246205542 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16114 (secure 0 0 0) 0x7f2d740f2190 con 0x7f2d8006a4c0 2024-01-24T12:44:53.104 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:53.104 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:52.772755+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 msgr2=0x7f2d6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 0x7f2d6c067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d800bdab0 tx=0x7f2d70009040 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 msgr2=0x7f2d800b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d7401b840 tx=0x7f2d7401b9d0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 shutdown_connections 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f2d6c065a90 0x7f2d6c067f50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f2d8014b540 0x7f2d800b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f2d8006a900 0x7f2d800b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 --2- 172.21.15.27:0/3246205542 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2d8006a4c0 0x7f2d800b9f50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 >> 172.21.15.27:0/3246205542 conn(0x7f2d800c02e0 msgr2=0x7f2d80148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 shutdown_connections 2024-01-24T12:44:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.102+0000 7f2d85a7f640 1 -- 172.21.15.27:0/3246205542 wait complete. 2024-01-24T12:44:53.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.230+0000 7febdca79640 1 Processor -- start 2024-01-24T12:44:53.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.230+0000 7febdca79640 1 -- start start 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febdca79640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7febd80708d0 0x7febd8070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febdca79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7febd8147920 0x7febd81440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febdca79640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80b2c80 con 0x7febd8071a20 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febdca79640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd806fdb0 con 0x7febd8147920 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febdca79640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd8070370 con 0x7febd80708d0 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7febd8147920 0x7febd81440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7febd8147920 0x7febd81440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50358/0 (socket says 172.21.15.27:50358) 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 -- 172.21.15.27:0/3370756575 learned_addr learned my addr 172.21.15.27:0/3370756575 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd659c640 1 --2- 172.21.15.27:0/3370756575 >> v2:172.21.15.124:3300/0 conn(0x7febd80708d0 0x7febd8070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 -- 172.21.15.27:0/3370756575 >> v2:172.21.15.124:3300/0 conn(0x7febd80708d0 msgr2=0x7febd8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 --2- 172.21.15.27:0/3370756575 >> v2:172.21.15.124:3300/0 conn(0x7febd80708d0 0x7febd8070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 -- 172.21.15.27:0/3370756575 >> v1:172.21.15.27:6789/0 conn(0x7febd8071a20 legacy=0x7febd8147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 -- 172.21.15.27:0/3370756575 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80b2ed0 con 0x7febd8147920 2024-01-24T12:44:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd6d9d640 1 --2- 172.21.15.27:0/3370756575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81440d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7febd806d0c0 tx=0x7febd001e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f61a7c54b4d7cf server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd559a640 1 -- 172.21.15.27:0/3370756575 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0004230 con 0x7febd8147920 2024-01-24T12:44:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd559a640 1 -- 172.21.15.27:0/3370756575 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd00ab070 con 0x7febd8147920 2024-01-24T12:44:53.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.234+0000 7febd559a640 1 -- 172.21.15.27:0/3370756575 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00a7870 con 0x7febd8147920 2024-01-24T12:44:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/3370756575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 msgr2=0x7febd81440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- 172.21.15.27:0/3370756575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81440d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7febd806d0c0 tx=0x7febd001e980 comp rx=0 tx=0).stop 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/3370756575 shutdown_connections 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- 172.21.15.27:0/3370756575 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81440d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- 172.21.15.27:0/3370756575 >> v2:172.21.15.124:3300/0 conn(0x7febd80708d0 0x7febd8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/3370756575 >> 172.21.15.27:0/3370756575 conn(0x7febd8069ef0 msgr2=0x7febd806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/3370756575 shutdown_connections 2024-01-24T12:44:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/3370756575 wait complete. 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 Processor -- start 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- start start 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 0x7febd813c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7febd8071a20 0x7febd81e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd813cdc0 con 0x7febd8147920 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81debf0 con 0x7febd80708d0 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd81515b0 con 0x7febd8071a20 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50366/0 (socket says 172.21.15.27:50366) 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 -- 172.21.15.27:0/1298506980 learned_addr learned my addr 172.21.15.27:0/1298506980 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd5d9b640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7febd8071a20 0x7febd81e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd659c640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 0x7febd813c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 -- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7febd8071a20 msgr2=0x7febd81e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7febd8071a20 0x7febd81e2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 -- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 msgr2=0x7febd813c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 0x7febd813c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 -- 172.21.15.27:0/1298506980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd000b780 con 0x7febd8147920 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd659c640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 0x7febd813c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febd6d9d640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febd001d030 tx=0x7febd001b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0006de0 con 0x7febd8147920 2024-01-24T12:44:53.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0003620 con 0x7febd8147920 2024-01-24T12:44:53.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00039d0 con 0x7febd8147920 2024-01-24T12:44:53.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd81dee70 con 0x7febd8147920 2024-01-24T12:44:53.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd81df430 con 0x7febd8147920 2024-01-24T12:44:53.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.238+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd804e000 con 0x7febd8147920 2024-01-24T12:44:53.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.242+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febd0003b30 con 0x7febd8147920 2024-01-24T12:44:53.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.242+0000 7febceffd640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 0x7febb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.242+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febd011f6a0 con 0x7febd8147920 2024-01-24T12:44:53.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.242+0000 7febd659c640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 0x7febb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.242+0000 7febd659c640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 0x7febb8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7febc0007330 tx=0x7febc000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.246+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7febd00ecfc0 con 0x7febd8147920 2024-01-24T12:44:53.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.398+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febd80bb740 con 0x7febd8147920 2024-01-24T12:44:53.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.398+0000 7febceffd640 1 -- 172.21.15.27:0/1298506980 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16114 (secure 0 0 0) 0x7febd00f05e0 con 0x7febd8147920 2024-01-24T12:44:53.401 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:53.401 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":30,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:52.772755+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 msgr2=0x7febb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 0x7febb8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7febc0007330 tx=0x7febc000b040 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 msgr2=0x7febd81e2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febd001d030 tx=0x7febd001b720 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 shutdown_connections 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7febb8065a60 0x7febb8067f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7febd8147920 0x7febd81e2660 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7febd8071a20 0x7febd81e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 --2- 172.21.15.27:0/1298506980 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7febd80708d0 0x7febd813c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 >> 172.21.15.27:0/1298506980 conn(0x7febd8069ef0 msgr2=0x7febd80bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 shutdown_connections 2024-01-24T12:44:53.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.402+0000 7febdca79640 1 -- 172.21.15.27:0/1298506980 wait complete. 2024-01-24T12:44:53.420 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T12:44:53.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 Processor -- start 2024-01-24T12:44:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 -- start start 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 0x7f831c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f831c144a80 0x7f831c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c0b6e80 con 0x7f831c144f10 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0b7160 con 0x7f831c144a80 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8322ec4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0bc6c0 con 0x7f831c0b8b40 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f831c144a80 0x7f831c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8321461640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f831c144f10 0x7f831c14dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60102/0 (socket says 172.21.15.27:60102) 2024-01-24T12:44:53.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8321461640 1 -- 172.21.15.27:0/3675130860 learned_addr learned my addr 172.21.15.27:0/3675130860 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8320c60640 1 --2- 172.21.15.27:0/3675130860 >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 0x7f831c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831bfff640 1 -- 172.21.15.27:0/3675130860 >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 msgr2=0x7f831c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831b7fe640 1 -- 172.21.15.27:0/3675130860 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920840095 0 0) 0x7f831c0b6e80 con 0x7f831c144f10 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831bfff640 1 --2- 172.21.15.27:0/3675130860 >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 0x7f831c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831bfff640 1 -- 172.21.15.27:0/3675130860 >> v1:172.21.15.27:6789/0 conn(0x7f831c144f10 legacy=0x7f831c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f831bfff640 1 -- 172.21.15.27:0/3675130860 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0bc9a0 con 0x7f831c144a80 2024-01-24T12:44:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.534+0000 7f8320c60640 1 --2- 172.21.15.27:0/3675130860 >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 0x7f831c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- 172.21.15.27:0/3675130860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c14ac60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ba8f0 tx=0x7f831001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e02f1d18ecdc20 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831b7fe640 1 -- 172.21.15.27:0/3675130860 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a8950 con 0x7f831c144a80 2024-01-24T12:44:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831b7fe640 1 -- 172.21.15.27:0/3675130860 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a8ab0 con 0x7f831c144a80 2024-01-24T12:44:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831b7fe640 1 -- 172.21.15.27:0/3675130860 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a8e40 con 0x7f831c144a80 2024-01-24T12:44:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/3675130860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 msgr2=0x7f831c14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- 172.21.15.27:0/3675130860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c14ac60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ba8f0 tx=0x7f831001ec50 comp rx=0 tx=0).stop 2024-01-24T12:44:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/3675130860 shutdown_connections 2024-01-24T12:44:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- 172.21.15.27:0/3675130860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c14ac60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- 172.21.15.27:0/3675130860 >> v2:172.21.15.124:3300/0 conn(0x7f831c0b8b40 0x7f831c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/3675130860 >> 172.21.15.27:0/3675130860 conn(0x7f831c0c02f0 msgr2=0x7f831c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/3675130860 shutdown_connections 2024-01-24T12:44:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/3675130860 wait complete. 2024-01-24T12:44:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 Processor -- start 2024-01-24T12:44:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- start start 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 0x7f831c1e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f831c144f10 0x7f831c1e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1e3650 con 0x7f831c144a80 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0a7d00 con 0x7f831c0b8b40 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1e3e00 con 0x7f831c144f10 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50382/0 (socket says 172.21.15.27:50382) 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 -- 172.21.15.27:0/2245360844 learned_addr learned my addr 172.21.15.27:0/2245360844 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8320c60640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 0x7f831c1e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 -- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f831c144f10 msgr2=0x7f831c1e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f831c144f10 0x7f831c1e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 -- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 msgr2=0x7f831c1e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 0x7f831c1e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 -- 172.21.15.27:0/2245360844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009420 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8320c60640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 0x7f831c1e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f831bfff640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f831001d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a8950 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310004030 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c0a6890 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100043c0 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1e3b20 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.538+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c0a6a20 con 0x7f831c144a80 2024-01-24T12:44:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.542+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8310003620 con 0x7f831c144a80 2024-01-24T12:44:53.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.542+0000 7f83197fa640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 0x7f8308067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.542+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83101215f0 con 0x7f831c144a80 2024-01-24T12:44:53.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.542+0000 7f8320c60640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 0x7f8308067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.542+0000 7f8320c60640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 0x7f8308067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f830c008930 tx=0x7f830c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.546+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f83100ef160 con 0x7f831c144a80 2024-01-24T12:44:53.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.726+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f831c0a6a20 con 0x7f831c144a80 2024-01-24T12:44:53.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f83197fa640 1 -- 172.21.15.27:0/2245360844 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83100f2780 con 0x7f831c144a80 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 msgr2=0x7f8308067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 0x7f8308067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f830c008930 tx=0x7f830c008040 comp rx=0 tx=0).stop 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 msgr2=0x7f831c0a77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f831001d490 comp rx=0 tx=0).stop 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 shutdown_connections 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f8308065a60 0x7f8308067f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f831c144f10 0x7f831c1e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f831c144a80 0x7f831c0a77c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 --2- 172.21.15.27:0/2245360844 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f831c0b8b40 0x7f831c1e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 >> 172.21.15.27:0/2245360844 conn(0x7f831c0c02f0 msgr2=0x7f831c0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 shutdown_connections 2024-01-24T12:44:53.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.782+0000 7f8322ec4640 1 -- 172.21.15.27:0/2245360844 wait complete. 2024-01-24T12:44:53.802 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-24T12:44:53.802 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-24T12:44:53.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 Processor -- start 2024-01-24T12:44:53.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 -- start start 2024-01-24T12:44:53.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 0x7f0e3c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e3c144f10 0x7f0e3c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0b6e80 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b7160 con 0x7f0e3c144f10 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e408dc640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0bc6c0 con 0x7f0e3c144a80 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3ad9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0e3c144f10 0x7f0e3c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3a59c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0e3c0b8b40 0x7f0e3c0b8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60112/0 (socket says 172.21.15.27:60112) 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3a59c640 1 -- 172.21.15.27:0/4292372598 learned_addr learned my addr 172.21.15.27:0/4292372598 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e39d9b640 1 --2- 172.21.15.27:0/4292372598 >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 0x7f0e3c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3ad9d640 1 -- 172.21.15.27:0/4292372598 >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 msgr2=0x7f0e3c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3ad9d640 1 --2- 172.21.15.27:0/4292372598 >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 0x7f0e3c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3ad9d640 1 -- 172.21.15.27:0/4292372598 >> v1:172.21.15.27:6789/0 conn(0x7f0e3c0b8b40 legacy=0x7f0e3c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3ad9d640 1 -- 172.21.15.27:0/4292372598 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0bc9a0 con 0x7f0e3c144f10 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e3959a640 1 -- 172.21.15.27:0/4292372598 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759297573 0 0) 0x7f0e3c0b6e80 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.918+0000 7f0e39d9b640 1 --2- 172.21.15.27:0/4292372598 >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 0x7f0e3c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:53.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e3ad9d640 1 --2- 172.21.15.27:0/4292372598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c144f10 0x7f0e3c14b1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c06ae90 tx=0x7f0e3401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e4db38ce58f872 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e3959a640 1 -- 172.21.15.27:0/4292372598 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340b0440 con 0x7f0e3c144f10 2024-01-24T12:44:53.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e3959a640 1 -- 172.21.15.27:0/4292372598 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e340b05a0 con 0x7f0e3c144f10 2024-01-24T12:44:53.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e3959a640 1 -- 172.21.15.27:0/4292372598 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340b0930 con 0x7f0e3c144f10 2024-01-24T12:44:53.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- 172.21.15.27:0/4292372598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c144f10 msgr2=0x7f0e3c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 --2- 172.21.15.27:0/4292372598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c144f10 0x7f0e3c14b1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c06ae90 tx=0x7f0e3401f0f0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- 172.21.15.27:0/4292372598 shutdown_connections 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 --2- 172.21.15.27:0/4292372598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c144f10 0x7f0e3c14b1a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 --2- 172.21.15.27:0/4292372598 >> v2:172.21.15.124:3300/0 conn(0x7f0e3c144a80 0x7f0e3c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- 172.21.15.27:0/4292372598 >> 172.21.15.27:0/4292372598 conn(0x7f0e3c0c02f0 msgr2=0x7f0e3c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- 172.21.15.27:0/4292372598 shutdown_connections 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- 172.21.15.27:0/4292372598 wait complete. 2024-01-24T12:44:53.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 Processor -- start 2024-01-24T12:44:53.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.922+0000 7f0e408dc640 1 -- start start 2024-01-24T12:44:53.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e3c144a80 0x7f0e3c1e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e3c144f10 0x7f0e3c0a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0a6ee0 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1e34f0 con 0x7f0e3c144a80 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c144740 con 0x7f0e3c144f10 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50398/0 (socket says 172.21.15.27:50398) 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 -- 172.21.15.27:0/3492035778 learned_addr learned my addr 172.21.15.27:0/3492035778 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 -- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e3c144f10 msgr2=0x7f0e3c0a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e3c144f10 0x7f0e3c0a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 -- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e3c144a80 msgr2=0x7f0e3c1e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:53.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e3c144a80 0x7f0e3c1e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 -- 172.21.15.27:0/3492035778 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009a70 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e3a59c640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0011f0 tx=0x7f0e2c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0074e0 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c007640 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1e2ea0 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c004a10 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0b03d0 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c067050 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e2c004b70 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 0x7f0e1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:53.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e2c0826b0 con 0x7f0e3c0b8b40 2024-01-24T12:44:53.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.926+0000 7f0e39d9b640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 0x7f0e1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:53.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.930+0000 7f0e39d9b640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 0x7f0e1c067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0a7450 tx=0x7f0e30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:53.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:53.930+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0e2c050100 con 0x7f0e3c0b8b40 2024-01-24T12:44:54.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.114+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e3c04e000 con 0x7f0e3c0b8b40 2024-01-24T12:44:54.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.790+0000 7f0e2affd640 1 -- 172.21.15.27:0/3492035778 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e2c053720 con 0x7f0e3c0b8b40 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 msgr2=0x7f0e1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 0x7f0e1c067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0a7450 tx=0x7f0e30008040 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 msgr2=0x7f0e3c1e0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0011f0 tx=0x7f0e2c00c9b0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 shutdown_connections 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e1c065a60 0x7f0e1c067f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0e3c144f10 0x7f0e3c0a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0e3c144a80 0x7f0e3c1e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 --2- 172.21.15.27:0/3492035778 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0e3c0b8b40 0x7f0e3c1e0da0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 >> 172.21.15.27:0/3492035778 conn(0x7f0e3c0c02f0 msgr2=0x7f0e3c0bab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 shutdown_connections 2024-01-24T12:44:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.794+0000 7f0e408dc640 1 -- 172.21.15.27:0/3492035778 wait complete. 2024-01-24T12:44:54.817 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-24T12:44:54.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.934+0000 7fb2b785f640 1 Processor -- start 2024-01-24T12:44:54.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.934+0000 7fb2b785f640 1 -- start start 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b785f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb2b0148d60 0x7fb2b01491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b785f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb2b0151100 0x7fb2b01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b785f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b0071770 con 0x7fb2b00bc340 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b785f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b01496f0 con 0x7fb2b0148d60 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b785f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b0142f20 con 0x7fb2b0151100 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b55fb640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb2b00bc340 0x7fb2b0142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60126/0 (socket says 172.21.15.27:60126) 2024-01-24T12:44:54.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b55fb640 1 -- 172.21.15.27:0/3628064096 learned_addr learned my addr 172.21.15.27:0/3628064096 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 --2- 172.21.15.27:0/3628064096 >> v2:172.21.15.27:3300/0 conn(0x7fb2b0148d60 0x7fb2b01491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b5dfc640 1 --2- 172.21.15.27:0/3628064096 >> v2:172.21.15.124:3300/0 conn(0x7fb2b0151100 0x7fb2b01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2a3fff640 1 -- 172.21.15.27:0/3628064096 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318200533 0 0) 0x7fb2b0071770 con 0x7fb2b00bc340 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2a3fff640 1 -- 172.21.15.27:0/3628064096 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb29c003530 con 0x7fb2b00bc340 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 -- 172.21.15.27:0/3628064096 >> v2:172.21.15.124:3300/0 conn(0x7fb2b0151100 msgr2=0x7fb2b01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 --2- 172.21.15.27:0/3628064096 >> v2:172.21.15.124:3300/0 conn(0x7fb2b0151100 0x7fb2b01534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 -- 172.21.15.27:0/3628064096 >> v1:172.21.15.27:6789/0 conn(0x7fb2b00bc340 legacy=0x7fb2b0142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 -- 172.21.15.27:0/3628064096 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00b37e0 con 0x7fb2b0148d60 2024-01-24T12:44:54.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2b4dfa640 1 --2- 172.21.15.27:0/3628064096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b0148d60 0x7fb2b01491b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb2b01463e0 tx=0x7fb2ac01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15622f406c9001bb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:54.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2a3fff640 1 -- 172.21.15.27:0/3628064096 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a8950 con 0x7fb2b0148d60 2024-01-24T12:44:54.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2a3fff640 1 -- 172.21.15.27:0/3628064096 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0a8ab0 con 0x7fb2b0148d60 2024-01-24T12:44:54.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.938+0000 7fb2a3fff640 1 -- 172.21.15.27:0/3628064096 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a8e40 con 0x7fb2b0148d60 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3628064096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b0148d60 msgr2=0x7fb2b01491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3628064096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b0148d60 0x7fb2b01491b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb2b01463e0 tx=0x7fb2ac01ec50 comp rx=0 tx=0).stop 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3628064096 shutdown_connections 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3628064096 >> v2:172.21.15.124:3300/0 conn(0x7fb2b0151100 0x7fb2b01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3628064096 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b0148d60 0x7fb2b01491b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3628064096 >> 172.21.15.27:0/3628064096 conn(0x7fb2b0069ef0 msgr2=0x7fb2b006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3628064096 shutdown_connections 2024-01-24T12:44:54.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3628064096 wait complete. 2024-01-24T12:44:54.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 Processor -- start 2024-01-24T12:44:54.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- start start 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2b0148d60 0x7fb2b006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2b0151100 0x7fb2b0139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b013b8c0 con 0x7fb2b00bc340 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0146ec0 con 0x7fb2b0148d60 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0070490 con 0x7fb2b0151100 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50408/0 (socket says 172.21.15.27:50408) 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 -- 172.21.15.27:0/3631612431 learned_addr learned my addr 172.21.15.27:0/3631612431 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 -- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2b0151100 msgr2=0x7fb2b0139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2b0151100 0x7fb2b0139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 -- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2b0148d60 msgr2=0x7fb2b006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2b0148d60 0x7fb2b006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 -- 172.21.15.27:0/3631612431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac009420 con 0x7fb2b00bc340 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b55fb640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4d0 tx=0x7fb2a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005cf0 con 0x7fb2b00bc340 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4005e50 con 0x7fb2b00bc340 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4007270 con 0x7fb2b00bc340 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0146be0 con 0x7fb2b00bc340 2024-01-24T12:44:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.942+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b006fa30 con 0x7fb2b00bc340 2024-01-24T12:44:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b006fc20 con 0x7fb2b00bc340 2024-01-24T12:44:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2a40073d0 con 0x7fb2b00bc340 2024-01-24T12:44:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2a1ffb640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 0x7fb294067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2a40826a0 con 0x7fb2b00bc340 2024-01-24T12:44:54.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2b4dfa640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 0x7fb294067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:54.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.946+0000 7fb2b4dfa640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 0x7fb294067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0b2000 tx=0x7fb2ac004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:54.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:54.950+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb2a4053ba0 con 0x7fb2b00bc340 2024-01-24T12:44:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.134+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2b0146940 con 0x7fb2b00bc340 2024-01-24T12:44:55.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.134+0000 7fb2a1ffb640 1 -- 172.21.15.27:0/3631612431 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7fb2a4017090 con 0x7fb2b00bc340 2024-01-24T12:44:55.138 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:55.138 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T12:44:55.139 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T12:44:55.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 msgr2=0x7fb294067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 0x7fb294067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0b2000 tx=0x7fb2ac004740 comp rx=0 tx=0).stop 2024-01-24T12:44:55.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 msgr2=0x7fb2b013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4d0 tx=0x7fb2a400c990 comp rx=0 tx=0).stop 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 shutdown_connections 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb294065a60 0x7fb294067f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb2b0151100 0x7fb2b0139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb2b0148d60 0x7fb2b006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 --2- 172.21.15.27:0/3631612431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb2b00bc340 0x7fb2b013b380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 >> 172.21.15.27:0/3631612431 conn(0x7fb2b0069ef0 msgr2=0x7fb2b00b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 shutdown_connections 2024-01-24T12:44:55.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.138+0000 7fb2b785f640 1 -- 172.21.15.27:0/3631612431 wait complete. 2024-01-24T12:44:55.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T12:44:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.270+0000 7f3eb4867640 1 Processor -- start 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.270+0000 7f3eb4867640 1 -- start start 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eb4867640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f3eb00b7fd0 0x7f3eb006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eb4867640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3eb00b6920 0x7f3eb00b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eb4867640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00b72b0 con 0x7f3eb00bc340 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eb4867640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb014f150 con 0x7f3eb00b6920 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eb4867640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb014f430 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3eb00b6920 0x7f3eb00b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3eb00b6920 0x7f3eb00b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50422/0 (socket says 172.21.15.27:50422) 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 -- 172.21.15.27:0/1480853038 learned_addr learned my addr 172.21.15.27:0/1480853038 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eadd9b640 1 --2- 172.21.15.27:0/1480853038 >> v2:172.21.15.124:3300/0 conn(0x7f3eb00b7fd0 0x7f3eb006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 -- 172.21.15.27:0/1480853038 >> v2:172.21.15.124:3300/0 conn(0x7f3eb00b7fd0 msgr2=0x7f3eb006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 --2- 172.21.15.27:0/1480853038 >> v2:172.21.15.124:3300/0 conn(0x7f3eb00b7fd0 0x7f3eb006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 -- 172.21.15.27:0/1480853038 >> v1:172.21.15.124:6789/0 conn(0x7f3eb00bc340 legacy=0x7f3eb0148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 -- 172.21.15.27:0/1480853038 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb014f710 con 0x7f3eb00b6920 2024-01-24T12:44:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3eaed9d640 1 --2- 172.21.15.27:0/1480853038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b6920 0x7f3eb00b6d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00716a0 tx=0x7f3ea801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d56f5e35d625d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.274+0000 7f3ead59a640 1 -- 172.21.15.27:0/1480853038 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80a57f0 con 0x7f3eb00b6920 2024-01-24T12:44:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3ead59a640 1 -- 172.21.15.27:0/1480853038 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80a5950 con 0x7f3eb00b6920 2024-01-24T12:44:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3ead59a640 1 -- 172.21.15.27:0/1480853038 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80a5ce0 con 0x7f3eb00b6920 2024-01-24T12:44:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/1480853038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b6920 msgr2=0x7f3eb00b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- 172.21.15.27:0/1480853038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b6920 0x7f3eb00b6d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00716a0 tx=0x7f3ea801c910 comp rx=0 tx=0).stop 2024-01-24T12:44:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/1480853038 shutdown_connections 2024-01-24T12:44:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- 172.21.15.27:0/1480853038 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b6920 0x7f3eb00b6d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- 172.21.15.27:0/1480853038 >> v2:172.21.15.124:3300/0 conn(0x7f3eb00b7fd0 0x7f3eb006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/1480853038 >> 172.21.15.27:0/1480853038 conn(0x7f3eb0069ef0 msgr2=0x7f3eb006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/1480853038 shutdown_connections 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/1480853038 wait complete. 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 Processor -- start 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- start start 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eb00b6920 0x7f3eb0152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3eb00bc340 0x7f3eb00ba820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0150510 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01507f0 con 0x7f3eb00b6920 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00b9dc0 con 0x7f3eb00bc340 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50434/0 (socket says 172.21.15.27:50434) 2024-01-24T12:44:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 -- 172.21.15.27:0/789955834 learned_addr learned my addr 172.21.15.27:0/789955834 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 -- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3eb00bc340 msgr2=0x7f3eb00ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eaed9d640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3eb00bc340 0x7f3eb00ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eae59c640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eb00b6920 0x7f3eb0152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3eb00bc340 0x7f3eb00ba820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 -- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eb00b6920 msgr2=0x7f3eb0152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eb00b6920 0x7f3eb0152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 -- 172.21.15.27:0/789955834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8009b30 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eadd9b640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400e930 tx=0x7f3ea400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4009690 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400ca00 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb0152e70 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400cd70 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.278+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00bb8e0 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb00b9f80 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ea4013470 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3e9effd640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 0x7f3e90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ea40833f0 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3eae59c640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 0x7f3e90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.282+0000 7f3eae59c640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 0x7f3e90067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0007fd0 tx=0x7f3ea0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.286+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f3ea4050f00 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.434+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3eb0150650 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.434+0000 7f3e9effd640 1 -- 172.21.15.27:0/789955834 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f3eb0150650 con 0x7f3eb00b7fd0 2024-01-24T12:44:55.438 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:55.438 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:53.778203+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T12:44:55.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 msgr2=0x7f3e90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 0x7f3e90067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0007fd0 tx=0x7f3ea0009040 comp rx=0 tx=0).stop 2024-01-24T12:44:55.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 msgr2=0x7f3eb00ba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400e930 tx=0x7f3ea400edf0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 shutdown_connections 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3e90065a60 0x7f3e90067f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f3eb00bc340 0x7f3eb00ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3eb00b7fd0 0x7f3eb00ba2e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 --2- 172.21.15.27:0/789955834 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f3eb00b6920 0x7f3eb0152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 >> 172.21.15.27:0/789955834 conn(0x7f3eb0069ef0 msgr2=0x7f3eb006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 shutdown_connections 2024-01-24T12:44:55.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.438+0000 7f3eb4867640 1 -- 172.21.15.27:0/789955834 wait complete. 2024-01-24T12:44:55.458 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-24T12:44:55.458 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:55.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.574+0000 7f366e0f4640 1 Processor -- start 2024-01-24T12:44:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.574+0000 7f366e0f4640 1 -- start start 2024-01-24T12:44:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f366e0f4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 0x7f36680bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f366e0f4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f366806a4c0 0x7f366806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f366e0f4640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680bc590 con 0x7f366814dfd0 2024-01-24T12:44:55.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f366e0f4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366806ae40 con 0x7f366806a4c0 2024-01-24T12:44:55.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f366e0f4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680bc320 con 0x7f366814b540 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f365ffff640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f366806a4c0 0x7f366806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f36677fe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 0x7f36680bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f3667fff640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f366814dfd0 0x7f366814e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:39442/0 (socket says 172.21.15.27:39442) 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f3667fff640 1 -- 172.21.15.27:0/1787778018 learned_addr learned my addr 172.21.15.27:0/1787778018 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f36677fe640 1 -- 172.21.15.27:0/1787778018 >> v2:172.21.15.124:3300/0 conn(0x7f366806a4c0 msgr2=0x7f366806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f36677fe640 1 --2- 172.21.15.27:0/1787778018 >> v2:172.21.15.124:3300/0 conn(0x7f366806a4c0 0x7f366806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f36677fe640 1 -- 172.21.15.27:0/1787778018 >> v1:172.21.15.124:6789/0 conn(0x7f366814dfd0 legacy=0x7f366814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.578+0000 7f36677fe640 1 -- 172.21.15.27:0/1787778018 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680b3a10 con 0x7f366814b540 2024-01-24T12:44:55.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f36677fe640 1 --2- 172.21.15.27:0/1787778018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 0x7f36680bac60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36580097c0 tx=0x7f365801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4f7d195a00f6e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f3666ffd640 1 -- 172.21.15.27:0/1787778018 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a8970 con 0x7f366814b540 2024-01-24T12:44:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f3666ffd640 1 -- 172.21.15.27:0/1787778018 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580a8ad0 con 0x7f366814b540 2024-01-24T12:44:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f3666ffd640 1 -- 172.21.15.27:0/1787778018 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a8e60 con 0x7f366814b540 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- 172.21.15.27:0/1787778018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 msgr2=0x7f36680bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- 172.21.15.27:0/1787778018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 0x7f36680bac60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f36580097c0 tx=0x7f365801ec70 comp rx=0 tx=0).stop 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- 172.21.15.27:0/1787778018 shutdown_connections 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- 172.21.15.27:0/1787778018 >> v2:172.21.15.124:3300/0 conn(0x7f366806a4c0 0x7f366806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- 172.21.15.27:0/1787778018 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814b540 0x7f36680bac60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- 172.21.15.27:0/1787778018 >> 172.21.15.27:0/1787778018 conn(0x7f36680c02e0 msgr2=0x7f36680c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- 172.21.15.27:0/1787778018 shutdown_connections 2024-01-24T12:44:55.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- 172.21.15.27:0/1787778018 wait complete. 2024-01-24T12:44:55.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 Processor -- start 2024-01-24T12:44:55.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- start start 2024-01-24T12:44:55.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f366814b540 0x7f36681e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814dfd0 0x7f36680a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680a4400 con 0x7f366806a4c0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366814dc70 con 0x7f366814b540 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f366e0f4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680a3d80 con 0x7f366814dfd0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f36677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f36677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50446/0 (socket says 172.21.15.27:50446) 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.582+0000 7f36677fe640 1 -- 172.21.15.27:0/2785977814 learned_addr learned my addr 172.21.15.27:0/2785977814 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f365ffff640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f366814b540 0x7f36681e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3667fff640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814dfd0 0x7f36680a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 -- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814dfd0 msgr2=0x7f36680a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814dfd0 0x7f36680a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 -- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f366814b540 msgr2=0x7f36681e3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f366814b540 0x7f36681e3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 -- 172.21.15.27:0/2785977814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658009420 con 0x7f366806a4c0 2024-01-24T12:44:55.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f36677fe640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f365801d320 tx=0x7f365801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580bf070 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580b1c00 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b9410 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680a37c0 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366814d0f0 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366814cf50 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f36580b7040 con 0x7f366806a4c0 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36581204f0 con 0x7f366806a4c0 2024-01-24T12:44:55.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f365ffff640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.586+0000 7f365ffff640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 0x7f3648067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36681e4ac0 tx=0x7f3650008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.594+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f366814cf50 con 0x7f366806a4c0 2024-01-24T12:44:55.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.750+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36680bfce0 con 0x7f3648065a60 2024-01-24T12:44:55.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.770+0000 7f3664ff9640 1 -- 172.21.15.27:0/2785977814 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264647 (secure 0 0 0) 0x7f3650011950 con 0x7f3648065a60 2024-01-24T12:44:55.775 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:55.777 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 msgr2=0x7f3648067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 0x7f3648067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36681e4ac0 tx=0x7f3650008040 comp rx=0 tx=0).stop 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 msgr2=0x7f366814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f365801d320 tx=0x7f365801ba10 comp rx=0 tx=0).stop 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 shutdown_connections 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f366814dfd0 0x7f36680a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f366814b540 0x7f36681e3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 --2- 172.21.15.27:0/2785977814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366806a4c0 0x7f366814d610 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 >> 172.21.15.27:0/2785977814 conn(0x7f36680c02e0 msgr2=0x7f3668148190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 shutdown_connections 2024-01-24T12:44:55.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.774+0000 7f366e0f4640 1 -- 172.21.15.27:0/2785977814 wait complete. 2024-01-24T12:44:55.794 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-01-24T12:44:55.635227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220096,"kb_used_data":3896,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754624,"statfs":{"total":773094113280,"available":772868734976,"internally_reserved":0,"allocated":3989504,"data_stored":2234356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.249916"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795017+0000","last_change":"2024-01-24T12:44:52.838181+0000","last_active":"2024-01-24T12:44:53.795017+0000","last_peered":"2024-01-24T12:44:53.795017+0000","last_clean":"2024-01-24T12:44:53.795017+0000","last_became_active":"2024-01-24T12:44:52.836122+0000","last_became_peered":"2024-01-24T12:44:52.836122+0000","last_unstale":"2024-01-24T12:44:53.795017+0000","last_undegraded":"2024-01-24T12:44:53.795017+0000","last_fullsized":"2024-01-24T12:44:53.795017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:29.359331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808699+0000","last_change":"2024-01-24T12:44:52.802308+0000","last_active":"2024-01-24T12:44:52.808699+0000","last_peered":"2024-01-24T12:44:52.808699+0000","last_clean":"2024-01-24T12:44:52.808699+0000","last_became_active":"2024-01-24T12:44:52.794182+0000","last_became_peered":"2024-01-24T12:44:52.794182+0000","last_unstale":"2024-01-24T12:44:52.808699+0000","last_undegraded":"2024-01-24T12:44:52.808699+0000","last_fullsized":"2024-01-24T12:44:52.808699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:32.483347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794078+0000","last_change":"2024-01-24T12:44:52.818271+0000","last_active":"2024-01-24T12:44:53.794078+0000","last_peered":"2024-01-24T12:44:53.794078+0000","last_clean":"2024-01-24T12:44:53.794078+0000","last_became_active":"2024-01-24T12:44:52.816576+0000","last_became_peered":"2024-01-24T12:44:52.816576+0000","last_unstale":"2024-01-24T12:44:53.794078+0000","last_undegraded":"2024-01-24T12:44:53.794078+0000","last_fullsized":"2024-01-24T12:44:53.794078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843658+0000","last_change":"2024-01-24T12:44:52.838842+0000","last_active":"2024-01-24T12:44:52.843658+0000","last_peered":"2024-01-24T12:44:52.843658+0000","last_clean":"2024-01-24T12:44:52.843658+0000","last_became_active":"2024-01-24T12:44:52.838306+0000","last_became_peered":"2024-01-24T12:44:52.838306+0000","last_unstale":"2024-01-24T12:44:52.843658+0000","last_undegraded":"2024-01-24T12:44:52.843658+0000","last_fullsized":"2024-01-24T12:44:52.843658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133479+0000","last_change":"2024-01-24T12:44:52.792269+0000","last_active":"2024-01-24T12:44:54.133479+0000","last_peered":"2024-01-24T12:44:54.133479+0000","last_clean":"2024-01-24T12:44:54.133479+0000","last_became_active":"2024-01-24T12:44:52.791981+0000","last_became_peered":"2024-01-24T12:44:52.791981+0000","last_unstale":"2024-01-24T12:44:54.133479+0000","last_undegraded":"2024-01-24T12:44:54.133479+0000","last_fullsized":"2024-01-24T12:44:54.133479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:17.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.817928+0000","last_change":"2024-01-24T12:44:52.817256+0000","last_active":"2024-01-24T12:44:52.817928+0000","last_peered":"2024-01-24T12:44:52.817928+0000","last_clean":"2024-01-24T12:44:52.817928+0000","last_became_active":"2024-01-24T12:44:52.816917+0000","last_became_peered":"2024-01-24T12:44:52.816917+0000","last_unstale":"2024-01-24T12:44:52.817928+0000","last_undegraded":"2024-01-24T12:44:52.817928+0000","last_fullsized":"2024-01-24T12:44:52.817928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:26.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839559+0000","last_change":"2024-01-24T12:44:52.832537+0000","last_active":"2024-01-24T12:44:52.839559+0000","last_peered":"2024-01-24T12:44:52.839559+0000","last_clean":"2024-01-24T12:44:52.839559+0000","last_became_active":"2024-01-24T12:44:52.832031+0000","last_became_peered":"2024-01-24T12:44:52.832031+0000","last_unstale":"2024-01-24T12:44:52.839559+0000","last_undegraded":"2024-01-24T12:44:52.839559+0000","last_fullsized":"2024-01-24T12:44:52.839559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834708+0000","last_change":"2024-01-24T12:44:52.825094+0000","last_active":"2024-01-24T12:44:52.834708+0000","last_peered":"2024-01-24T12:44:52.834708+0000","last_clean":"2024-01-24T12:44:52.834708+0000","last_became_active":"2024-01-24T12:44:52.823935+0000","last_became_peered":"2024-01-24T12:44:52.823935+0000","last_unstale":"2024-01-24T12:44:52.834708+0000","last_undegraded":"2024-01-24T12:44:52.834708+0000","last_fullsized":"2024-01-24T12:44:52.834708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796977+0000","last_change":"2024-01-24T12:44:52.836272+0000","last_active":"2024-01-24T12:44:53.796977+0000","last_peered":"2024-01-24T12:44:53.796977+0000","last_clean":"2024-01-24T12:44:53.796977+0000","last_became_active":"2024-01-24T12:44:52.835650+0000","last_became_peered":"2024-01-24T12:44:52.835650+0000","last_unstale":"2024-01-24T12:44:53.796977+0000","last_undegraded":"2024-01-24T12:44:53.796977+0000","last_fullsized":"2024-01-24T12:44:53.796977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.801878+0000","last_change":"2024-01-24T12:44:52.794927+0000","last_active":"2024-01-24T12:44:52.801878+0000","last_peered":"2024-01-24T12:44:52.801878+0000","last_clean":"2024-01-24T12:44:52.801878+0000","last_became_active":"2024-01-24T12:44:52.794659+0000","last_became_peered":"2024-01-24T12:44:52.794659+0000","last_unstale":"2024-01-24T12:44:52.801878+0000","last_undegraded":"2024-01-24T12:44:52.801878+0000","last_fullsized":"2024-01-24T12:44:52.801878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:36.218189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.838069+0000","last_change":"2024-01-24T12:44:52.827614+0000","last_active":"2024-01-24T12:44:52.838069+0000","last_peered":"2024-01-24T12:44:52.838069+0000","last_clean":"2024-01-24T12:44:52.838069+0000","last_became_active":"2024-01-24T12:44:52.826766+0000","last_became_peered":"2024-01-24T12:44:52.826766+0000","last_unstale":"2024-01-24T12:44:52.838069+0000","last_undegraded":"2024-01-24T12:44:52.838069+0000","last_fullsized":"2024-01-24T12:44:52.838069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793863+0000","last_change":"2024-01-24T12:44:52.815174+0000","last_active":"2024-01-24T12:44:53.793863+0000","last_peered":"2024-01-24T12:44:53.793863+0000","last_clean":"2024-01-24T12:44:53.793863+0000","last_became_active":"2024-01-24T12:44:52.814111+0000","last_became_peered":"2024-01-24T12:44:52.814111+0000","last_unstale":"2024-01-24T12:44:53.793863+0000","last_undegraded":"2024-01-24T12:44:53.793863+0000","last_fullsized":"2024-01-24T12:44:53.793863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:32.483347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133538+0000","last_change":"2024-01-24T12:44:52.795098+0000","last_active":"2024-01-24T12:44:54.133538+0000","last_peered":"2024-01-24T12:44:54.133538+0000","last_clean":"2024-01-24T12:44:54.133538+0000","last_became_active":"2024-01-24T12:44:52.794796+0000","last_became_peered":"2024-01-24T12:44:52.794796+0000","last_unstale":"2024-01-24T12:44:54.133538+0000","last_undegraded":"2024-01-24T12:44:54.133538+0000","last_fullsized":"2024-01-24T12:44:54.133538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:37.182711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.794226+0000","last_change":"2024-01-24T12:44:52.792257+0000","last_active":"2024-01-24T12:44:52.794226+0000","last_peered":"2024-01-24T12:44:52.794226+0000","last_clean":"2024-01-24T12:44:52.794226+0000","last_became_active":"2024-01-24T12:44:52.791950+0000","last_became_peered":"2024-01-24T12:44:52.791950+0000","last_unstale":"2024-01-24T12:44:52.794226+0000","last_undegraded":"2024-01-24T12:44:52.794226+0000","last_fullsized":"2024-01-24T12:44:52.794226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793014+0000","last_change":"2024-01-24T12:44:52.814795+0000","last_active":"2024-01-24T12:44:53.793014+0000","last_peered":"2024-01-24T12:44:53.793014+0000","last_clean":"2024-01-24T12:44:53.793014+0000","last_became_active":"2024-01-24T12:44:52.813586+0000","last_became_peered":"2024-01-24T12:44:52.813586+0000","last_unstale":"2024-01-24T12:44:53.793014+0000","last_undegraded":"2024-01-24T12:44:53.793014+0000","last_fullsized":"2024-01-24T12:44:53.793014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834790+0000","last_change":"2024-01-24T12:44:52.825695+0000","last_active":"2024-01-24T12:44:52.834790+0000","last_peered":"2024-01-24T12:44:52.834790+0000","last_clean":"2024-01-24T12:44:52.834790+0000","last_became_active":"2024-01-24T12:44:52.825037+0000","last_became_peered":"2024-01-24T12:44:52.825037+0000","last_unstale":"2024-01-24T12:44:52.834790+0000","last_undegraded":"2024-01-24T12:44:52.834790+0000","last_fullsized":"2024-01-24T12:44:52.834790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.838192+0000","last_change":"2024-01-24T12:44:52.831194+0000","last_active":"2024-01-24T12:44:52.838192+0000","last_peered":"2024-01-24T12:44:52.838192+0000","last_clean":"2024-01-24T12:44:52.838192+0000","last_became_active":"2024-01-24T12:44:52.830406+0000","last_became_peered":"2024-01-24T12:44:52.830406+0000","last_unstale":"2024-01-24T12:44:52.838192+0000","last_undegraded":"2024-01-24T12:44:52.838192+0000","last_fullsized":"2024-01-24T12:44:52.838192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:32:48.901652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808735+0000","last_change":"2024-01-24T12:44:52.803088+0000","last_active":"2024-01-24T12:44:52.808735+0000","last_peered":"2024-01-24T12:44:52.808735+0000","last_clean":"2024-01-24T12:44:52.808735+0000","last_became_active":"2024-01-24T12:44:52.802782+0000","last_became_peered":"2024-01-24T12:44:52.802782+0000","last_unstale":"2024-01-24T12:44:52.808735+0000","last_undegraded":"2024-01-24T12:44:52.808735+0000","last_fullsized":"2024-01-24T12:44:52.808735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:56:48.995375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808887+0000","last_change":"2024-01-24T12:44:52.803392+0000","last_active":"2024-01-24T12:44:52.808887+0000","last_peered":"2024-01-24T12:44:52.808887+0000","last_clean":"2024-01-24T12:44:52.808887+0000","last_became_active":"2024-01-24T12:44:52.802117+0000","last_became_peered":"2024-01-24T12:44:52.802117+0000","last_unstale":"2024-01-24T12:44:52.808887+0000","last_undegraded":"2024-01-24T12:44:52.808887+0000","last_fullsized":"2024-01-24T12:44:52.808887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133681+0000","last_change":"2024-01-24T12:44:52.815157+0000","last_active":"2024-01-24T12:44:54.133681+0000","last_peered":"2024-01-24T12:44:54.133681+0000","last_clean":"2024-01-24T12:44:54.133681+0000","last_became_active":"2024-01-24T12:44:52.814904+0000","last_became_peered":"2024-01-24T12:44:52.814904+0000","last_unstale":"2024-01-24T12:44:54.133681+0000","last_undegraded":"2024-01-24T12:44:54.133681+0000","last_fullsized":"2024-01-24T12:44:54.133681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:09.851293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795832+0000","last_change":"2024-01-24T12:44:52.808049+0000","last_active":"2024-01-24T12:44:53.795832+0000","last_peered":"2024-01-24T12:44:53.795832+0000","last_clean":"2024-01-24T12:44:53.795832+0000","last_became_active":"2024-01-24T12:44:52.806386+0000","last_became_peered":"2024-01-24T12:44:52.806386+0000","last_unstale":"2024-01-24T12:44:53.795832+0000","last_undegraded":"2024-01-24T12:44:53.795832+0000","last_fullsized":"2024-01-24T12:44:53.795832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:09.270960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795804+0000","last_change":"2024-01-24T12:44:52.830256+0000","last_active":"2024-01-24T12:44:53.795804+0000","last_peered":"2024-01-24T12:44:53.795804+0000","last_clean":"2024-01-24T12:44:53.795804+0000","last_became_active":"2024-01-24T12:44:52.823186+0000","last_became_peered":"2024-01-24T12:44:52.823186+0000","last_unstale":"2024-01-24T12:44:53.795804+0000","last_undegraded":"2024-01-24T12:44:53.795804+0000","last_fullsized":"2024-01-24T12:44:53.795804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:40:12.189291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.821331+0000","last_change":"2024-01-24T12:44:52.818207+0000","last_active":"2024-01-24T12:44:52.821331+0000","last_peered":"2024-01-24T12:44:52.821331+0000","last_clean":"2024-01-24T12:44:52.821331+0000","last_became_active":"2024-01-24T12:44:52.818030+0000","last_became_peered":"2024-01-24T12:44:52.818030+0000","last_unstale":"2024-01-24T12:44:52.821331+0000","last_undegraded":"2024-01-24T12:44:52.821331+0000","last_fullsized":"2024-01-24T12:44:52.821331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:09.270960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792721+0000","last_change":"2024-01-24T12:44:52.813715+0000","last_active":"2024-01-24T12:44:53.792721+0000","last_peered":"2024-01-24T12:44:53.792721+0000","last_clean":"2024-01-24T12:44:53.792721+0000","last_became_active":"2024-01-24T12:44:52.812571+0000","last_became_peered":"2024-01-24T12:44:52.812571+0000","last_unstale":"2024-01-24T12:44:53.792721+0000","last_undegraded":"2024-01-24T12:44:53.792721+0000","last_fullsized":"2024-01-24T12:44:53.792721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:26.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.828114+0000","last_change":"2024-01-24T12:44:52.824996+0000","last_active":"2024-01-24T12:44:52.828114+0000","last_peered":"2024-01-24T12:44:52.828114+0000","last_clean":"2024-01-24T12:44:52.828114+0000","last_became_active":"2024-01-24T12:44:52.824721+0000","last_became_peered":"2024-01-24T12:44:52.824721+0000","last_unstale":"2024-01-24T12:44:52.828114+0000","last_undegraded":"2024-01-24T12:44:52.828114+0000","last_fullsized":"2024-01-24T12:44:52.828114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.823188+0000","last_change":"2024-01-24T12:44:52.818416+0000","last_active":"2024-01-24T12:44:52.823188+0000","last_peered":"2024-01-24T12:44:52.823188+0000","last_clean":"2024-01-24T12:44:52.823188+0000","last_became_active":"2024-01-24T12:44:52.818068+0000","last_became_peered":"2024-01-24T12:44:52.818068+0000","last_unstale":"2024-01-24T12:44:52.823188+0000","last_undegraded":"2024-01-24T12:44:52.823188+0000","last_fullsized":"2024-01-24T12:44:52.823188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:49.883499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843606+0000","last_change":"2024-01-24T12:44:52.838576+0000","last_active":"2024-01-24T12:44:52.843606+0000","last_peered":"2024-01-24T12:44:52.843606+0000","last_clean":"2024-01-24T12:44:52.843606+0000","last_became_active":"2024-01-24T12:44:52.838239+0000","last_became_peered":"2024-01-24T12:44:52.838239+0000","last_unstale":"2024-01-24T12:44:52.843606+0000","last_undegraded":"2024-01-24T12:44:52.843606+0000","last_fullsized":"2024-01-24T12:44:52.843606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793903+0000","last_change":"2024-01-24T12:44:52.814942+0000","last_active":"2024-01-24T12:44:53.793903+0000","last_peered":"2024-01-24T12:44:53.793903+0000","last_clean":"2024-01-24T12:44:53.793903+0000","last_became_active":"2024-01-24T12:44:52.813261+0000","last_became_peered":"2024-01-24T12:44:52.813261+0000","last_unstale":"2024-01-24T12:44:53.793903+0000","last_undegraded":"2024-01-24T12:44:53.793903+0000","last_fullsized":"2024-01-24T12:44:53.793903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:32:48.901652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795952+0000","last_change":"2024-01-24T12:44:52.808521+0000","last_active":"2024-01-24T12:44:53.795952+0000","last_peered":"2024-01-24T12:44:53.795952+0000","last_clean":"2024-01-24T12:44:53.795952+0000","last_became_active":"2024-01-24T12:44:52.807313+0000","last_became_peered":"2024-01-24T12:44:52.807313+0000","last_unstale":"2024-01-24T12:44:53.795952+0000","last_undegraded":"2024-01-24T12:44:53.795952+0000","last_fullsized":"2024-01-24T12:44:53.795952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839302+0000","last_change":"2024-01-24T12:44:52.831280+0000","last_active":"2024-01-24T12:44:52.839302+0000","last_peered":"2024-01-24T12:44:52.839302+0000","last_clean":"2024-01-24T12:44:52.839302+0000","last_became_active":"2024-01-24T12:44:52.830637+0000","last_became_peered":"2024-01-24T12:44:52.830637+0000","last_unstale":"2024-01-24T12:44:52.839302+0000","last_undegraded":"2024-01-24T12:44:52.839302+0000","last_fullsized":"2024-01-24T12:44:52.839302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795134+0000","last_change":"2024-01-24T12:44:52.809764+0000","last_active":"2024-01-24T12:44:53.795134+0000","last_peered":"2024-01-24T12:44:53.795134+0000","last_clean":"2024-01-24T12:44:53.795134+0000","last_became_active":"2024-01-24T12:44:52.808972+0000","last_became_peered":"2024-01-24T12:44:52.808972+0000","last_unstale":"2024-01-24T12:44:53.795134+0000","last_undegraded":"2024-01-24T12:44:53.795134+0000","last_fullsized":"2024-01-24T12:44:53.795134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:45.334410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.848050+0000","last_change":"2024-01-24T12:44:52.845198+0000","last_active":"2024-01-24T12:44:52.848050+0000","last_peered":"2024-01-24T12:44:52.848050+0000","last_clean":"2024-01-24T12:44:52.848050+0000","last_became_active":"2024-01-24T12:44:52.844517+0000","last_became_peered":"2024-01-24T12:44:52.844517+0000","last_unstale":"2024-01-24T12:44:52.848050+0000","last_undegraded":"2024-01-24T12:44:52.848050+0000","last_fullsized":"2024-01-24T12:44:52.848050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.811034+0000","last_change":"2024-01-24T12:44:52.808888+0000","last_active":"2024-01-24T12:44:52.811034+0000","last_peered":"2024-01-24T12:44:52.811034+0000","last_clean":"2024-01-24T12:44:52.811034+0000","last_became_active":"2024-01-24T12:44:52.808566+0000","last_became_peered":"2024-01-24T12:44:52.808566+0000","last_unstale":"2024-01-24T12:44:52.811034+0000","last_undegraded":"2024-01-24T12:44:52.811034+0000","last_fullsized":"2024-01-24T12:44:52.811034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795450+0000","last_change":"2024-01-24T12:44:52.433985+0000","last_active":"2024-01-24T12:44:53.795450+0000","last_peered":"2024-01-24T12:44:53.795450+0000","last_clean":"2024-01-24T12:44:53.795450+0000","last_became_active":"2024-01-24T12:44:52.433396+0000","last_became_peered":"2024-01-24T12:44:52.433396+0000","last_unstale":"2024-01-24T12:44:53.795450+0000","last_undegraded":"2024-01-24T12:44:53.795450+0000","last_fullsized":"2024-01-24T12:44:53.795450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:16.635991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795236+0000","last_change":"2024-01-24T12:44:52.839415+0000","last_active":"2024-01-24T12:44:53.795236+0000","last_peered":"2024-01-24T12:44:53.795236+0000","last_clean":"2024-01-24T12:44:53.795236+0000","last_became_active":"2024-01-24T12:44:52.838773+0000","last_became_peered":"2024-01-24T12:44:52.838773+0000","last_unstale":"2024-01-24T12:44:53.795236+0000","last_undegraded":"2024-01-24T12:44:53.795236+0000","last_fullsized":"2024-01-24T12:44:53.795236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:10.074555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.817894+0000","last_change":"2024-01-24T12:44:52.433057+0000","last_active":"2024-01-24T12:44:52.817894+0000","last_peered":"2024-01-24T12:44:52.817894+0000","last_clean":"2024-01-24T12:44:52.817894+0000","last_became_active":"2024-01-24T12:44:52.432636+0000","last_became_peered":"2024-01-24T12:44:52.432636+0000","last_unstale":"2024-01-24T12:44:52.817894+0000","last_undegraded":"2024-01-24T12:44:52.817894+0000","last_fullsized":"2024-01-24T12:44:52.817894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:47.520409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796239+0000","last_change":"2024-01-24T12:44:52.823101+0000","last_active":"2024-01-24T12:44:53.796239+0000","last_peered":"2024-01-24T12:44:53.796239+0000","last_clean":"2024-01-24T12:44:53.796239+0000","last_became_active":"2024-01-24T12:44:52.822303+0000","last_became_peered":"2024-01-24T12:44:52.822303+0000","last_unstale":"2024-01-24T12:44:53.796239+0000","last_undegraded":"2024-01-24T12:44:53.796239+0000","last_fullsized":"2024-01-24T12:44:53.796239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.805387+0000","last_change":"2024-01-24T12:44:52.424153+0000","last_active":"2024-01-24T12:44:52.805387+0000","last_peered":"2024-01-24T12:44:52.805387+0000","last_clean":"2024-01-24T12:44:52.805387+0000","last_became_active":"2024-01-24T12:44:52.423609+0000","last_became_peered":"2024-01-24T12:44:52.423609+0000","last_unstale":"2024-01-24T12:44:52.805387+0000","last_undegraded":"2024-01-24T12:44:52.805387+0000","last_fullsized":"2024-01-24T12:44:52.805387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:09.070665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843640+0000","last_change":"2024-01-24T12:44:52.838634+0000","last_active":"2024-01-24T12:44:52.843640+0000","last_peered":"2024-01-24T12:44:52.843640+0000","last_clean":"2024-01-24T12:44:52.843640+0000","last_became_active":"2024-01-24T12:44:52.838334+0000","last_became_peered":"2024-01-24T12:44:52.838334+0000","last_unstale":"2024-01-24T12:44:52.843640+0000","last_undegraded":"2024-01-24T12:44:52.843640+0000","last_fullsized":"2024-01-24T12:44:52.843640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133822+0000","last_change":"2024-01-24T12:44:52.426849+0000","last_active":"2024-01-24T12:44:54.133822+0000","last_peered":"2024-01-24T12:44:54.133822+0000","last_clean":"2024-01-24T12:44:54.133822+0000","last_became_active":"2024-01-24T12:44:52.426573+0000","last_became_peered":"2024-01-24T12:44:52.426573+0000","last_unstale":"2024-01-24T12:44:54.133822+0000","last_undegraded":"2024-01-24T12:44:54.133822+0000","last_fullsized":"2024-01-24T12:44:54.133822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:41:30.217245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.847988+0000","last_change":"2024-01-24T12:44:52.845098+0000","last_active":"2024-01-24T12:44:52.847988+0000","last_peered":"2024-01-24T12:44:52.847988+0000","last_clean":"2024-01-24T12:44:52.847988+0000","last_became_active":"2024-01-24T12:44:52.844471+0000","last_became_peered":"2024-01-24T12:44:52.844471+0000","last_unstale":"2024-01-24T12:44:52.847988+0000","last_undegraded":"2024-01-24T12:44:52.847988+0000","last_fullsized":"2024-01-24T12:44:52.847988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796092+0000","last_change":"2024-01-24T12:44:52.436652+0000","last_active":"2024-01-24T12:44:53.796092+0000","last_peered":"2024-01-24T12:44:53.796092+0000","last_clean":"2024-01-24T12:44:53.796092+0000","last_became_active":"2024-01-24T12:44:52.435053+0000","last_became_peered":"2024-01-24T12:44:52.435053+0000","last_unstale":"2024-01-24T12:44:53.796092+0000","last_undegraded":"2024-01-24T12:44:53.796092+0000","last_fullsized":"2024-01-24T12:44:53.796092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:36.178822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792833+0000","last_change":"2024-01-24T12:44:52.815196+0000","last_active":"2024-01-24T12:44:53.792833+0000","last_peered":"2024-01-24T12:44:53.792833+0000","last_clean":"2024-01-24T12:44:53.792833+0000","last_became_active":"2024-01-24T12:44:52.812733+0000","last_became_peered":"2024-01-24T12:44:52.812733+0000","last_unstale":"2024-01-24T12:44:53.792833+0000","last_undegraded":"2024-01-24T12:44:53.792833+0000","last_fullsized":"2024-01-24T12:44:53.792833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:52.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796017+0000","last_change":"2024-01-24T12:44:52.430963+0000","last_active":"2024-01-24T12:44:53.796017+0000","last_peered":"2024-01-24T12:44:53.796017+0000","last_clean":"2024-01-24T12:44:53.796017+0000","last_became_active":"2024-01-24T12:44:52.430166+0000","last_became_peered":"2024-01-24T12:44:52.430166+0000","last_unstale":"2024-01-24T12:44:53.796017+0000","last_undegraded":"2024-01-24T12:44:53.796017+0000","last_fullsized":"2024-01-24T12:44:53.796017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:16.635991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793085+0000","last_change":"2024-01-24T12:44:52.807288+0000","last_active":"2024-01-24T12:44:53.793085+0000","last_peered":"2024-01-24T12:44:53.793085+0000","last_clean":"2024-01-24T12:44:53.793085+0000","last_became_active":"2024-01-24T12:44:52.806092+0000","last_became_peered":"2024-01-24T12:44:52.806092+0000","last_unstale":"2024-01-24T12:44:53.793085+0000","last_undegraded":"2024-01-24T12:44:53.793085+0000","last_fullsized":"2024-01-24T12:44:53.793085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786768+0000","last_change":"2024-01-24T12:44:52.422086+0000","last_active":"2024-01-24T12:44:52.786768+0000","last_peered":"2024-01-24T12:44:52.786768+0000","last_clean":"2024-01-24T12:44:52.786768+0000","last_became_active":"2024-01-24T12:44:52.421675+0000","last_became_peered":"2024-01-24T12:44:52.421675+0000","last_unstale":"2024-01-24T12:44:52.786768+0000","last_undegraded":"2024-01-24T12:44:52.786768+0000","last_fullsized":"2024-01-24T12:44:52.786768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:28.355442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.816297+0000","last_change":"2024-01-24T12:44:52.813800+0000","last_active":"2024-01-24T12:44:52.816297+0000","last_peered":"2024-01-24T12:44:52.816297+0000","last_clean":"2024-01-24T12:44:52.816297+0000","last_became_active":"2024-01-24T12:44:52.813479+0000","last_became_peered":"2024-01-24T12:44:52.813479+0000","last_unstale":"2024-01-24T12:44:52.816297+0000","last_undegraded":"2024-01-24T12:44:52.816297+0000","last_fullsized":"2024-01-24T12:44:52.816297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794931+0000","last_change":"2024-01-24T12:44:52.429652+0000","last_active":"2024-01-24T12:44:53.794931+0000","last_peered":"2024-01-24T12:44:53.794931+0000","last_clean":"2024-01-24T12:44:53.794931+0000","last_became_active":"2024-01-24T12:44:52.429000+0000","last_became_peered":"2024-01-24T12:44:52.429000+0000","last_unstale":"2024-01-24T12:44:53.794931+0000","last_undegraded":"2024-01-24T12:44:53.794931+0000","last_fullsized":"2024-01-24T12:44:53.794931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:04:34.961071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794433+0000","last_change":"2024-01-24T12:44:52.816644+0000","last_active":"2024-01-24T12:44:53.794433+0000","last_peered":"2024-01-24T12:44:53.794433+0000","last_clean":"2024-01-24T12:44:53.794433+0000","last_became_active":"2024-01-24T12:44:52.815870+0000","last_became_peered":"2024-01-24T12:44:52.815870+0000","last_unstale":"2024-01-24T12:44:53.794433+0000","last_undegraded":"2024-01-24T12:44:53.794433+0000","last_fullsized":"2024-01-24T12:44:53.794433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.787739+0000","last_change":"2024-01-24T12:44:52.430588+0000","last_active":"2024-01-24T12:44:52.787739+0000","last_peered":"2024-01-24T12:44:52.787739+0000","last_clean":"2024-01-24T12:44:52.787739+0000","last_became_active":"2024-01-24T12:44:52.429994+0000","last_became_peered":"2024-01-24T12:44:52.429994+0000","last_unstale":"2024-01-24T12:44:52.787739+0000","last_undegraded":"2024-01-24T12:44:52.787739+0000","last_fullsized":"2024-01-24T12:44:52.787739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:13:29.429181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808758+0000","last_change":"2024-01-24T12:44:52.801855+0000","last_active":"2024-01-24T12:44:52.808758+0000","last_peered":"2024-01-24T12:44:52.808758+0000","last_clean":"2024-01-24T12:44:52.808758+0000","last_became_active":"2024-01-24T12:44:52.801595+0000","last_became_peered":"2024-01-24T12:44:52.801595+0000","last_unstale":"2024-01-24T12:44:52.808758+0000","last_undegraded":"2024-01-24T12:44:52.808758+0000","last_fullsized":"2024-01-24T12:44:52.808758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784717+0000","last_change":"2024-01-24T12:44:52.421233+0000","last_active":"2024-01-24T12:44:52.784717+0000","last_peered":"2024-01-24T12:44:52.784717+0000","last_clean":"2024-01-24T12:44:52.784717+0000","last_became_active":"2024-01-24T12:44:52.418062+0000","last_became_peered":"2024-01-24T12:44:52.418062+0000","last_unstale":"2024-01-24T12:44:52.784717+0000","last_undegraded":"2024-01-24T12:44:52.784717+0000","last_fullsized":"2024-01-24T12:44:52.784717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.810297+0000","last_change":"2024-01-24T12:44:52.805488+0000","last_active":"2024-01-24T12:44:52.810297+0000","last_peered":"2024-01-24T12:44:52.810297+0000","last_clean":"2024-01-24T12:44:52.810297+0000","last_became_active":"2024-01-24T12:44:52.805216+0000","last_became_peered":"2024-01-24T12:44:52.805216+0000","last_unstale":"2024-01-24T12:44:52.810297+0000","last_undegraded":"2024-01-24T12:44:52.810297+0000","last_fullsized":"2024-01-24T12:44:52.810297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:31:15.169650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794300+0000","last_change":"2024-01-24T12:44:52.425453+0000","last_active":"2024-01-24T12:44:53.794300+0000","last_peered":"2024-01-24T12:44:53.794300+0000","last_clean":"2024-01-24T12:44:53.794300+0000","last_became_active":"2024-01-24T12:44:52.424962+0000","last_became_peered":"2024-01-24T12:44:52.424962+0000","last_unstale":"2024-01-24T12:44:53.794300+0000","last_undegraded":"2024-01-24T12:44:53.794300+0000","last_fullsized":"2024-01-24T12:44:53.794300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:28.355442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793834+0000","last_change":"2024-01-24T12:44:52.818770+0000","last_active":"2024-01-24T12:44:53.793834+0000","last_peered":"2024-01-24T12:44:53.793834+0000","last_clean":"2024-01-24T12:44:53.793834+0000","last_became_active":"2024-01-24T12:44:52.817453+0000","last_became_peered":"2024-01-24T12:44:52.817453+0000","last_unstale":"2024-01-24T12:44:53.793834+0000","last_undegraded":"2024-01-24T12:44:53.793834+0000","last_fullsized":"2024-01-24T12:44:53.793834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.846395+0000","last_change":"2024-01-24T12:44:52.424224+0000","last_active":"2024-01-24T12:44:52.846395+0000","last_peered":"2024-01-24T12:44:52.846395+0000","last_clean":"2024-01-24T12:44:52.846395+0000","last_became_active":"2024-01-24T12:44:52.423699+0000","last_became_peered":"2024-01-24T12:44:52.423699+0000","last_unstale":"2024-01-24T12:44:52.846395+0000","last_undegraded":"2024-01-24T12:44:52.846395+0000","last_fullsized":"2024-01-24T12:44:52.846395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:44.330520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.818848+0000","last_change":"2024-01-24T12:44:52.815679+0000","last_active":"2024-01-24T12:44:52.818848+0000","last_peered":"2024-01-24T12:44:52.818848+0000","last_clean":"2024-01-24T12:44:52.818848+0000","last_became_active":"2024-01-24T12:44:52.815448+0000","last_became_peered":"2024-01-24T12:44:52.815448+0000","last_unstale":"2024-01-24T12:44:52.818848+0000","last_undegraded":"2024-01-24T12:44:52.818848+0000","last_fullsized":"2024-01-24T12:44:52.818848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:40:12.189291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796200+0000","last_change":"2024-01-24T12:44:52.429840+0000","last_active":"2024-01-24T12:44:53.796200+0000","last_peered":"2024-01-24T12:44:53.796200+0000","last_clean":"2024-01-24T12:44:53.796200+0000","last_became_active":"2024-01-24T12:44:52.428966+0000","last_became_peered":"2024-01-24T12:44:52.428966+0000","last_unstale":"2024-01-24T12:44:53.796200+0000","last_undegraded":"2024-01-24T12:44:53.796200+0000","last_fullsized":"2024-01-24T12:44:53.796200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:08.847403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.801395+0000","last_change":"2024-01-24T12:44:52.793737+0000","last_active":"2024-01-24T12:44:52.801395+0000","last_peered":"2024-01-24T12:44:52.801395+0000","last_clean":"2024-01-24T12:44:52.801395+0000","last_became_active":"2024-01-24T12:44:52.793476+0000","last_became_peered":"2024-01-24T12:44:52.793476+0000","last_unstale":"2024-01-24T12:44:52.801395+0000","last_undegraded":"2024-01-24T12:44:52.801395+0000","last_fullsized":"2024-01-24T12:44:52.801395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786415+0000","last_change":"2024-01-24T12:44:52.420209+0000","last_active":"2024-01-24T12:44:52.786415+0000","last_peered":"2024-01-24T12:44:52.786415+0000","last_clean":"2024-01-24T12:44:52.786415+0000","last_became_active":"2024-01-24T12:44:52.419813+0000","last_became_peered":"2024-01-24T12:44:52.419813+0000","last_unstale":"2024-01-24T12:44:52.786415+0000","last_undegraded":"2024-01-24T12:44:52.786415+0000","last_fullsized":"2024-01-24T12:44:52.786415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:00.907883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.848092+0000","last_change":"2024-01-24T12:44:52.845243+0000","last_active":"2024-01-24T12:44:52.848092+0000","last_peered":"2024-01-24T12:44:52.848092+0000","last_clean":"2024-01-24T12:44:52.848092+0000","last_became_active":"2024-01-24T12:44:52.844663+0000","last_became_peered":"2024-01-24T12:44:52.844663+0000","last_unstale":"2024-01-24T12:44:52.848092+0000","last_undegraded":"2024-01-24T12:44:52.848092+0000","last_fullsized":"2024-01-24T12:44:52.848092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786650+0000","last_change":"2024-01-24T12:44:52.430759+0000","last_active":"2024-01-24T12:44:52.786650+0000","last_peered":"2024-01-24T12:44:52.786650+0000","last_clean":"2024-01-24T12:44:52.786650+0000","last_became_active":"2024-01-24T12:44:52.430031+0000","last_became_peered":"2024-01-24T12:44:52.430031+0000","last_unstale":"2024-01-24T12:44:52.786650+0000","last_undegraded":"2024-01-24T12:44:52.786650+0000","last_fullsized":"2024-01-24T12:44:52.786650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:00:07.874201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795358+0000","last_change":"2024-01-24T12:44:52.845054+0000","last_active":"2024-01-24T12:44:53.795358+0000","last_peered":"2024-01-24T12:44:53.795358+0000","last_clean":"2024-01-24T12:44:53.795358+0000","last_became_active":"2024-01-24T12:44:52.844430+0000","last_became_peered":"2024-01-24T12:44:52.844430+0000","last_unstale":"2024-01-24T12:44:53.795358+0000","last_undegraded":"2024-01-24T12:44:53.795358+0000","last_fullsized":"2024-01-24T12:44:53.795358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:00:08.878090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809534+0000","last_change":"2024-01-24T12:44:52.427361+0000","last_active":"2024-01-24T12:44:52.809534+0000","last_peered":"2024-01-24T12:44:52.809534+0000","last_clean":"2024-01-24T12:44:52.809534+0000","last_became_active":"2024-01-24T12:44:52.426796+0000","last_became_peered":"2024-01-24T12:44:52.426796+0000","last_unstale":"2024-01-24T12:44:52.809534+0000","last_undegraded":"2024-01-24T12:44:52.809534+0000","last_fullsized":"2024-01-24T12:44:52.809534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:52:31.119010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796525+0000","last_change":"2024-01-24T12:44:52.836399+0000","last_active":"2024-01-24T12:44:53.796525+0000","last_peered":"2024-01-24T12:44:53.796525+0000","last_clean":"2024-01-24T12:44:53.796525+0000","last_became_active":"2024-01-24T12:44:52.835798+0000","last_became_peered":"2024-01-24T12:44:52.835798+0000","last_unstale":"2024-01-24T12:44:53.796525+0000","last_undegraded":"2024-01-24T12:44:53.796525+0000","last_fullsized":"2024-01-24T12:44:53.796525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809134+0000","last_change":"2024-01-24T12:44:52.423144+0000","last_active":"2024-01-24T12:44:52.809134+0000","last_peered":"2024-01-24T12:44:52.809134+0000","last_clean":"2024-01-24T12:44:52.809134+0000","last_became_active":"2024-01-24T12:44:52.422789+0000","last_became_peered":"2024-01-24T12:44:52.422789+0000","last_unstale":"2024-01-24T12:44:52.809134+0000","last_undegraded":"2024-01-24T12:44:52.809134+0000","last_fullsized":"2024-01-24T12:44:52.809134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794243+0000","last_change":"2024-01-24T12:44:52.839056+0000","last_active":"2024-01-24T12:44:53.794243+0000","last_peered":"2024-01-24T12:44:53.794243+0000","last_clean":"2024-01-24T12:44:53.794243+0000","last_became_active":"2024-01-24T12:44:52.838470+0000","last_became_peered":"2024-01-24T12:44:52.838470+0000","last_unstale":"2024-01-24T12:44:53.794243+0000","last_undegraded":"2024-01-24T12:44:53.794243+0000","last_fullsized":"2024-01-24T12:44:53.794243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:53:29.174810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796760+0000","last_change":"2024-01-24T12:44:52.431502+0000","last_active":"2024-01-24T12:44:53.796760+0000","last_peered":"2024-01-24T12:44:53.796760+0000","last_clean":"2024-01-24T12:44:53.796760+0000","last_became_active":"2024-01-24T12:44:52.429328+0000","last_became_peered":"2024-01-24T12:44:52.429328+0000","last_unstale":"2024-01-24T12:44:53.796760+0000","last_undegraded":"2024-01-24T12:44:53.796760+0000","last_fullsized":"2024-01-24T12:44:53.796760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:40.466990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843636+0000","last_change":"2024-01-24T12:44:52.838605+0000","last_active":"2024-01-24T12:44:52.843636+0000","last_peered":"2024-01-24T12:44:52.843636+0000","last_clean":"2024-01-24T12:44:52.843636+0000","last_became_active":"2024-01-24T12:44:52.838276+0000","last_became_peered":"2024-01-24T12:44:52.838276+0000","last_unstale":"2024-01-24T12:44:52.843636+0000","last_undegraded":"2024-01-24T12:44:52.843636+0000","last_fullsized":"2024-01-24T12:44:52.843636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796705+0000","last_change":"2024-01-24T12:44:52.430574+0000","last_active":"2024-01-24T12:44:53.796705+0000","last_peered":"2024-01-24T12:44:53.796705+0000","last_clean":"2024-01-24T12:44:53.796705+0000","last_became_active":"2024-01-24T12:44:52.429095+0000","last_became_peered":"2024-01-24T12:44:52.429095+0000","last_unstale":"2024-01-24T12:44:53.796705+0000","last_undegraded":"2024-01-24T12:44:53.796705+0000","last_fullsized":"2024-01-24T12:44:53.796705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133836+0000","last_change":"2024-01-24T12:44:52.812753+0000","last_active":"2024-01-24T12:44:54.133836+0000","last_peered":"2024-01-24T12:44:54.133836+0000","last_clean":"2024-01-24T12:44:54.133836+0000","last_became_active":"2024-01-24T12:44:52.812378+0000","last_became_peered":"2024-01-24T12:44:52.812378+0000","last_unstale":"2024-01-24T12:44:54.133836+0000","last_undegraded":"2024-01-24T12:44:54.133836+0000","last_fullsized":"2024-01-24T12:44:54.133836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:22.994142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796358+0000","last_change":"2024-01-24T12:44:52.430168+0000","last_active":"2024-01-24T12:44:53.796358+0000","last_peered":"2024-01-24T12:44:53.796358+0000","last_clean":"2024-01-24T12:44:53.796358+0000","last_became_active":"2024-01-24T12:44:52.429589+0000","last_became_peered":"2024-01-24T12:44:52.429589+0000","last_unstale":"2024-01-24T12:44:53.796358+0000","last_undegraded":"2024-01-24T12:44:53.796358+0000","last_fullsized":"2024-01-24T12:44:53.796358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:37.280528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133454+0000","last_change":"2024-01-24T12:44:52.824252+0000","last_active":"2024-01-24T12:44:54.133454+0000","last_peered":"2024-01-24T12:44:54.133454+0000","last_clean":"2024-01-24T12:44:54.133454+0000","last_became_active":"2024-01-24T12:44:52.824056+0000","last_became_peered":"2024-01-24T12:44:52.824056+0000","last_unstale":"2024-01-24T12:44:54.133454+0000","last_undegraded":"2024-01-24T12:44:54.133454+0000","last_fullsized":"2024-01-24T12:44:54.133454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:38.284418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.804012+0000","last_change":"2024-01-24T12:44:52.409511+0000","last_active":"2024-01-24T12:44:52.804012+0000","last_peered":"2024-01-24T12:44:52.804012+0000","last_clean":"2024-01-24T12:44:52.804012+0000","last_became_active":"2024-01-24T12:44:52.409254+0000","last_became_peered":"2024-01-24T12:44:52.409254+0000","last_unstale":"2024-01-24T12:44:52.804012+0000","last_undegraded":"2024-01-24T12:44:52.804012+0000","last_fullsized":"2024-01-24T12:44:52.804012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133763+0000","last_change":"2024-01-24T12:44:52.794869+0000","last_active":"2024-01-24T12:44:54.133763+0000","last_peered":"2024-01-24T12:44:54.133763+0000","last_clean":"2024-01-24T12:44:54.133763+0000","last_became_active":"2024-01-24T12:44:52.794590+0000","last_became_peered":"2024-01-24T12:44:52.794590+0000","last_unstale":"2024-01-24T12:44:54.133763+0000","last_undegraded":"2024-01-24T12:44:54.133763+0000","last_fullsized":"2024-01-24T12:44:54.133763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:44.802079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794773+0000","last_change":"2024-01-24T12:44:52.427918+0000","last_active":"2024-01-24T12:44:53.794773+0000","last_peered":"2024-01-24T12:44:53.794773+0000","last_clean":"2024-01-24T12:44:53.794773+0000","last_became_active":"2024-01-24T12:44:52.427176+0000","last_became_peered":"2024-01-24T12:44:52.427176+0000","last_unstale":"2024-01-24T12:44:53.794773+0000","last_undegraded":"2024-01-24T12:44:53.794773+0000","last_fullsized":"2024-01-24T12:44:53.794773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:37.280528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133347+0000","last_change":"2024-01-24T12:44:52.794981+0000","last_active":"2024-01-24T12:44:54.133347+0000","last_peered":"2024-01-24T12:44:54.133347+0000","last_clean":"2024-01-24T12:44:54.133347+0000","last_became_active":"2024-01-24T12:44:52.793016+0000","last_became_peered":"2024-01-24T12:44:52.793016+0000","last_unstale":"2024-01-24T12:44:54.133347+0000","last_undegraded":"2024-01-24T12:44:54.133347+0000","last_fullsized":"2024-01-24T12:44:54.133347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:04:35.964961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795514+0000","last_change":"2024-01-24T12:44:52.431484+0000","last_active":"2024-01-24T12:44:53.795514+0000","last_peered":"2024-01-24T12:44:53.795514+0000","last_clean":"2024-01-24T12:44:53.795514+0000","last_became_active":"2024-01-24T12:44:52.429933+0000","last_became_peered":"2024-01-24T12:44:52.429933+0000","last_unstale":"2024-01-24T12:44:53.795514+0000","last_undegraded":"2024-01-24T12:44:53.795514+0000","last_fullsized":"2024-01-24T12:44:53.795514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839522+0000","last_change":"2024-01-24T12:44:52.827998+0000","last_active":"2024-01-24T12:44:52.839522+0000","last_peered":"2024-01-24T12:44:52.839522+0000","last_clean":"2024-01-24T12:44:52.839522+0000","last_became_active":"2024-01-24T12:44:52.827214+0000","last_became_peered":"2024-01-24T12:44:52.827214+0000","last_unstale":"2024-01-24T12:44:52.839522+0000","last_undegraded":"2024-01-24T12:44:52.839522+0000","last_fullsized":"2024-01-24T12:44:52.839522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792963+0000","last_change":"2024-01-24T12:44:52.433392+0000","last_active":"2024-01-24T12:44:53.792963+0000","last_peered":"2024-01-24T12:44:53.792963+0000","last_clean":"2024-01-24T12:44:53.792963+0000","last_became_active":"2024-01-24T12:44:52.432690+0000","last_became_peered":"2024-01-24T12:44:52.432690+0000","last_unstale":"2024-01-24T12:44:53.792963+0000","last_undegraded":"2024-01-24T12:44:53.792963+0000","last_fullsized":"2024-01-24T12:44:53.792963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:44.330520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133780+0000","last_change":"2024-01-24T12:44:52.831376+0000","last_active":"2024-01-24T12:44:54.133780+0000","last_peered":"2024-01-24T12:44:54.133780+0000","last_clean":"2024-01-24T12:44:54.133780+0000","last_became_active":"2024-01-24T12:44:52.831084+0000","last_became_peered":"2024-01-24T12:44:52.831084+0000","last_unstale":"2024-01-24T12:44:54.133780+0000","last_undegraded":"2024-01-24T12:44:54.133780+0000","last_fullsized":"2024-01-24T12:44:54.133780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:41.470880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.835970+0000","last_change":"2024-01-24T12:44:52.417127+0000","last_active":"2024-01-24T12:44:52.835970+0000","last_peered":"2024-01-24T12:44:52.835970+0000","last_clean":"2024-01-24T12:44:52.835970+0000","last_became_active":"2024-01-24T12:44:52.416522+0000","last_became_peered":"2024-01-24T12:44:52.416522+0000","last_unstale":"2024-01-24T12:44:52.835970+0000","last_undegraded":"2024-01-24T12:44:52.835970+0000","last_fullsized":"2024-01-24T12:44:52.835970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794342+0000","last_change":"2024-01-24T12:44:52.818779+0000","last_active":"2024-01-24T12:44:53.794342+0000","last_peered":"2024-01-24T12:44:53.794342+0000","last_clean":"2024-01-24T12:44:53.794342+0000","last_became_active":"2024-01-24T12:44:52.815184+0000","last_became_peered":"2024-01-24T12:44:52.815184+0000","last_unstale":"2024-01-24T12:44:53.794342+0000","last_undegraded":"2024-01-24T12:44:53.794342+0000","last_fullsized":"2024-01-24T12:44:53.794342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784825+0000","last_change":"2024-01-24T12:44:52.409506+0000","last_active":"2024-01-24T12:44:52.784825+0000","last_peered":"2024-01-24T12:44:52.784825+0000","last_clean":"2024-01-24T12:44:52.784825+0000","last_became_active":"2024-01-24T12:44:52.409200+0000","last_became_peered":"2024-01-24T12:44:52.409200+0000","last_unstale":"2024-01-24T12:44:52.784825+0000","last_undegraded":"2024-01-24T12:44:52.784825+0000","last_fullsized":"2024-01-24T12:44:52.784825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.799639+0000","last_change":"2024-01-24T12:44:52.796895+0000","last_active":"2024-01-24T12:44:52.799639+0000","last_peered":"2024-01-24T12:44:52.799639+0000","last_clean":"2024-01-24T12:44:52.799639+0000","last_became_active":"2024-01-24T12:44:52.796610+0000","last_became_peered":"2024-01-24T12:44:52.796610+0000","last_unstale":"2024-01-24T12:44:52.799639+0000","last_undegraded":"2024-01-24T12:44:52.799639+0000","last_fullsized":"2024-01-24T12:44:52.799639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786216+0000","last_change":"2024-01-24T12:44:52.419588+0000","last_active":"2024-01-24T12:44:52.786216+0000","last_peered":"2024-01-24T12:44:52.786216+0000","last_clean":"2024-01-24T12:44:52.786216+0000","last_became_active":"2024-01-24T12:44:52.419174+0000","last_became_peered":"2024-01-24T12:44:52.419174+0000","last_unstale":"2024-01-24T12:44:52.786216+0000","last_undegraded":"2024-01-24T12:44:52.786216+0000","last_fullsized":"2024-01-24T12:44:52.786216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:36.178822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794695+0000","last_change":"2024-01-24T12:44:52.806136+0000","last_active":"2024-01-24T12:44:53.794695+0000","last_peered":"2024-01-24T12:44:53.794695+0000","last_clean":"2024-01-24T12:44:53.794695+0000","last_became_active":"2024-01-24T12:44:52.805013+0000","last_became_peered":"2024-01-24T12:44:52.805013+0000","last_unstale":"2024-01-24T12:44:53.794695+0000","last_undegraded":"2024-01-24T12:44:53.794695+0000","last_fullsized":"2024-01-24T12:44:53.794695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:01.911773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784697+0000","last_change":"2024-01-24T12:44:52.412347+0000","last_active":"2024-01-24T12:44:52.784697+0000","last_peered":"2024-01-24T12:44:52.784697+0000","last_clean":"2024-01-24T12:44:52.784697+0000","last_became_active":"2024-01-24T12:44:52.411771+0000","last_became_peered":"2024-01-24T12:44:52.411771+0000","last_unstale":"2024-01-24T12:44:52.784697+0000","last_undegraded":"2024-01-24T12:44:52.784697+0000","last_fullsized":"2024-01-24T12:44:52.784697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:00.907883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809188+0000","last_change":"2024-01-24T12:44:52.806757+0000","last_active":"2024-01-24T12:44:52.809188+0000","last_peered":"2024-01-24T12:44:52.809188+0000","last_clean":"2024-01-24T12:44:52.809188+0000","last_became_active":"2024-01-24T12:44:52.806563+0000","last_became_peered":"2024-01-24T12:44:52.806563+0000","last_unstale":"2024-01-24T12:44:52.809188+0000","last_undegraded":"2024-01-24T12:44:52.809188+0000","last_fullsized":"2024-01-24T12:44:52.809188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:03.123823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786521+0000","last_change":"2024-01-24T12:44:52.417102+0000","last_active":"2024-01-24T12:44:52.786521+0000","last_peered":"2024-01-24T12:44:52.786521+0000","last_clean":"2024-01-24T12:44:52.786521+0000","last_became_active":"2024-01-24T12:44:52.416379+0000","last_became_peered":"2024-01-24T12:44:52.416379+0000","last_unstale":"2024-01-24T12:44:52.786521+0000","last_undegraded":"2024-01-24T12:44:52.786521+0000","last_fullsized":"2024-01-24T12:44:52.786521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808547+0000","last_change":"2024-01-24T12:44:52.801774+0000","last_active":"2024-01-24T12:44:52.808547+0000","last_peered":"2024-01-24T12:44:52.808547+0000","last_clean":"2024-01-24T12:44:52.808547+0000","last_became_active":"2024-01-24T12:44:52.801490+0000","last_became_peered":"2024-01-24T12:44:52.801490+0000","last_unstale":"2024-01-24T12:44:52.808547+0000","last_undegraded":"2024-01-24T12:44:52.808547+0000","last_fullsized":"2024-01-24T12:44:52.808547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:53:29.174810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795640+0000","last_change":"2024-01-24T12:44:52.429430+0000","last_active":"2024-01-24T12:44:53.795640+0000","last_peered":"2024-01-24T12:44:53.795640+0000","last_clean":"2024-01-24T12:44:53.795640+0000","last_became_active":"2024-01-24T12:44:52.428797+0000","last_became_peered":"2024-01-24T12:44:52.428797+0000","last_unstale":"2024-01-24T12:44:53.795640+0000","last_undegraded":"2024-01-24T12:44:53.795640+0000","last_fullsized":"2024-01-24T12:44:53.795640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795263+0000","last_change":"2024-01-24T12:44:52.828166+0000","last_active":"2024-01-24T12:44:53.795263+0000","last_peered":"2024-01-24T12:44:53.795263+0000","last_clean":"2024-01-24T12:44:53.795263+0000","last_became_active":"2024-01-24T12:44:52.822844+0000","last_became_peered":"2024-01-24T12:44:52.822844+0000","last_unstale":"2024-01-24T12:44:53.795263+0000","last_undegraded":"2024-01-24T12:44:53.795263+0000","last_fullsized":"2024-01-24T12:44:53.795263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786758+0000","last_change":"2024-01-24T12:44:52.433515+0000","last_active":"2024-01-24T12:44:52.786758+0000","last_peered":"2024-01-24T12:44:52.786758+0000","last_clean":"2024-01-24T12:44:52.786758+0000","last_became_active":"2024-01-24T12:44:52.432943+0000","last_became_peered":"2024-01-24T12:44:52.432943+0000","last_unstale":"2024-01-24T12:44:52.786758+0000","last_undegraded":"2024-01-24T12:44:52.786758+0000","last_fullsized":"2024-01-24T12:44:52.786758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:02.119933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834777+0000","last_change":"2024-01-24T12:44:52.825997+0000","last_active":"2024-01-24T12:44:52.834777+0000","last_peered":"2024-01-24T12:44:52.834777+0000","last_clean":"2024-01-24T12:44:52.834777+0000","last_became_active":"2024-01-24T12:44:52.825320+0000","last_became_peered":"2024-01-24T12:44:52.825320+0000","last_unstale":"2024-01-24T12:44:52.834777+0000","last_undegraded":"2024-01-24T12:44:52.834777+0000","last_fullsized":"2024-01-24T12:44:52.834777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794541+0000","last_change":"2024-01-24T12:44:52.438025+0000","last_active":"2024-01-24T12:44:53.794541+0000","last_peered":"2024-01-24T12:44:53.794541+0000","last_clean":"2024-01-24T12:44:53.794541+0000","last_became_active":"2024-01-24T12:44:52.437498+0000","last_became_peered":"2024-01-24T12:44:52.437498+0000","last_unstale":"2024-01-24T12:44:53.794541+0000","last_undegraded":"2024-01-24T12:44:53.794541+0000","last_fullsized":"2024-01-24T12:44:53.794541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:08.847403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.430759+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:52.430759+0000","last_peered":"2024-01-24T12:44:52.430759+0000","last_clean":"2024-01-24T12:44:52.430759+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:52.430759+0000","last_undegraded":"2024-01-24T12:44:52.430759+0000","last_fullsized":"2024-01-24T12:44:52.430759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":718420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":718330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:55.799 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T12:44:55.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.954+0000 7fb6cce19640 1 Processor -- start 2024-01-24T12:44:55.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.954+0000 7fb6cce19640 1 -- start start 2024-01-24T12:44:55.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6c80bc340 0x7fb6c81415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c8071550 con 0x7fb6c80b8020 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c8071810 con 0x7fb6c80bc340 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8071950 con 0x7fb6c8141b30 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb6c80bc340 0x7fb6c81415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c6d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb6c80b8020 0x7fb6c814abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60138/0 (socket says 172.21.15.27:60138) 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c6d9d640 1 -- 172.21.15.27:0/1766409149 learned_addr learned my addr 172.21.15.27:0/1766409149 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c5d9b640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 -- 172.21.15.27:0/1766409149 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 msgr2=0x7fb6c8147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 -- 172.21.15.27:0/1766409149 >> v1:172.21.15.27:6789/0 conn(0x7fb6c80b8020 legacy=0x7fb6c814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 -- 172.21.15.27:0/1766409149 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80bc720 con 0x7fb6c80bc340 2024-01-24T12:44:55.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c5d9b640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c659c640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81415f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097c0 tx=0x7fb6b801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce518d415ef50d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c559a640 1 -- 172.21.15.27:0/1766409149 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80ab600 con 0x7fb6c80bc340 2024-01-24T12:44:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c559a640 1 -- 172.21.15.27:0/1766409149 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80a7050 con 0x7fb6c80bc340 2024-01-24T12:44:55.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6c559a640 1 -- 172.21.15.27:0/1766409149 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80ab980 con 0x7fb6c80bc340 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- 172.21.15.27:0/1766409149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 msgr2=0x7fb6c81415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81415f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097c0 tx=0x7fb6b801c3f0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- 172.21.15.27:0/1766409149 shutdown_connections 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 --2- 172.21.15.27:0/1766409149 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81415f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- 172.21.15.27:0/1766409149 >> 172.21.15.27:0/1766409149 conn(0x7fb6c8069ef0 msgr2=0x7fb6c806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- 172.21.15.27:0/1766409149 shutdown_connections 2024-01-24T12:44:55.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.958+0000 7fb6cce19640 1 -- 172.21.15.27:0/1766409149 wait complete. 2024-01-24T12:44:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 Processor -- start 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- start start 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 0x7fb6c81e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c81e18c0 con 0x7fb6c80bc340 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c81e1ba0 con 0x7fb6c80b8020 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c81e1e80 con 0x7fb6c8141b30 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50464/0 (socket says 172.21.15.27:50464) 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 -- 172.21.15.27:0/4013995269 learned_addr learned my addr 172.21.15.27:0/4013995269 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c659c640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 0x7fb6c81e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 -- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 msgr2=0x7fb6c8133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 -- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 msgr2=0x7fb6c81e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 0x7fb6c81e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 -- 172.21.15.27:0/4013995269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b8009420 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c659c640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 0x7fb6c81e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6c5d9b640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c7f0 tx=0x7fb6bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0077c0 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc007920 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c81e2160 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc007cd0 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c8139cf0 con 0x7fb6c80bc340 2024-01-24T12:44:55.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c804e000 con 0x7fb6c80bc340 2024-01-24T12:44:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6bc0113f0 con 0x7fb6c80bc340 2024-01-24T12:44:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.962+0000 7fb6b6ffd640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 0x7fb6a8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.966+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6bc083400 con 0x7fb6c80bc340 2024-01-24T12:44:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.966+0000 7fb6c659c640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 0x7fb6a8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:55.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.966+0000 7fb6c659c640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 0x7fb6a8067f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80ad000 tx=0x7fb6b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:55.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:55.970+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb6bc050e50 con 0x7fb6c80bc340 2024-01-24T12:44:56.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.118+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6c80bbb00 con 0x7fb6a8065a90 2024-01-24T12:44:56.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6b6ffd640 1 -- 172.21.15.27:0/4013995269 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264647 (secure 0 0 0) 0x7fb6c81485b0 con 0x7fb6a8065a90 2024-01-24T12:44:56.142 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:56.144 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 msgr2=0x7fb6a8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 0x7fb6a8067f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80ad000 tx=0x7fb6b8008040 comp rx=0 tx=0).stop 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 msgr2=0x7fb6c81397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c7f0 tx=0x7fb6bc00ccb0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 shutdown_connections 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb6a8065a90 0x7fb6a8067f50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb6c8141b30 0x7fb6c8133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb6c80bc340 0x7fb6c81397b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 --2- 172.21.15.27:0/4013995269 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb6c80b8020 0x7fb6c81e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.138+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 >> 172.21.15.27:0/4013995269 conn(0x7fb6c8069ef0 msgr2=0x7fb6c813f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:56.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.142+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 shutdown_connections 2024-01-24T12:44:56.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.142+0000 7fb6cce19640 1 -- 172.21.15.27:0/4013995269 wait complete. 2024-01-24T12:44:56.158 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-01-24T12:44:55.635227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220096,"kb_used_data":3896,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754624,"statfs":{"total":773094113280,"available":772868734976,"internally_reserved":0,"allocated":3989504,"data_stored":2234356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.249916"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795017+0000","last_change":"2024-01-24T12:44:52.838181+0000","last_active":"2024-01-24T12:44:53.795017+0000","last_peered":"2024-01-24T12:44:53.795017+0000","last_clean":"2024-01-24T12:44:53.795017+0000","last_became_active":"2024-01-24T12:44:52.836122+0000","last_became_peered":"2024-01-24T12:44:52.836122+0000","last_unstale":"2024-01-24T12:44:53.795017+0000","last_undegraded":"2024-01-24T12:44:53.795017+0000","last_fullsized":"2024-01-24T12:44:53.795017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:29.359331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808699+0000","last_change":"2024-01-24T12:44:52.802308+0000","last_active":"2024-01-24T12:44:52.808699+0000","last_peered":"2024-01-24T12:44:52.808699+0000","last_clean":"2024-01-24T12:44:52.808699+0000","last_became_active":"2024-01-24T12:44:52.794182+0000","last_became_peered":"2024-01-24T12:44:52.794182+0000","last_unstale":"2024-01-24T12:44:52.808699+0000","last_undegraded":"2024-01-24T12:44:52.808699+0000","last_fullsized":"2024-01-24T12:44:52.808699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:32.483347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794078+0000","last_change":"2024-01-24T12:44:52.818271+0000","last_active":"2024-01-24T12:44:53.794078+0000","last_peered":"2024-01-24T12:44:53.794078+0000","last_clean":"2024-01-24T12:44:53.794078+0000","last_became_active":"2024-01-24T12:44:52.816576+0000","last_became_peered":"2024-01-24T12:44:52.816576+0000","last_unstale":"2024-01-24T12:44:53.794078+0000","last_undegraded":"2024-01-24T12:44:53.794078+0000","last_fullsized":"2024-01-24T12:44:53.794078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843658+0000","last_change":"2024-01-24T12:44:52.838842+0000","last_active":"2024-01-24T12:44:52.843658+0000","last_peered":"2024-01-24T12:44:52.843658+0000","last_clean":"2024-01-24T12:44:52.843658+0000","last_became_active":"2024-01-24T12:44:52.838306+0000","last_became_peered":"2024-01-24T12:44:52.838306+0000","last_unstale":"2024-01-24T12:44:52.843658+0000","last_undegraded":"2024-01-24T12:44:52.843658+0000","last_fullsized":"2024-01-24T12:44:52.843658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133479+0000","last_change":"2024-01-24T12:44:52.792269+0000","last_active":"2024-01-24T12:44:54.133479+0000","last_peered":"2024-01-24T12:44:54.133479+0000","last_clean":"2024-01-24T12:44:54.133479+0000","last_became_active":"2024-01-24T12:44:52.791981+0000","last_became_peered":"2024-01-24T12:44:52.791981+0000","last_unstale":"2024-01-24T12:44:54.133479+0000","last_undegraded":"2024-01-24T12:44:54.133479+0000","last_fullsized":"2024-01-24T12:44:54.133479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:17.639881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.817928+0000","last_change":"2024-01-24T12:44:52.817256+0000","last_active":"2024-01-24T12:44:52.817928+0000","last_peered":"2024-01-24T12:44:52.817928+0000","last_clean":"2024-01-24T12:44:52.817928+0000","last_became_active":"2024-01-24T12:44:52.816917+0000","last_became_peered":"2024-01-24T12:44:52.816917+0000","last_unstale":"2024-01-24T12:44:52.817928+0000","last_undegraded":"2024-01-24T12:44:52.817928+0000","last_fullsized":"2024-01-24T12:44:52.817928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:26.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839559+0000","last_change":"2024-01-24T12:44:52.832537+0000","last_active":"2024-01-24T12:44:52.839559+0000","last_peered":"2024-01-24T12:44:52.839559+0000","last_clean":"2024-01-24T12:44:52.839559+0000","last_became_active":"2024-01-24T12:44:52.832031+0000","last_became_peered":"2024-01-24T12:44:52.832031+0000","last_unstale":"2024-01-24T12:44:52.839559+0000","last_undegraded":"2024-01-24T12:44:52.839559+0000","last_fullsized":"2024-01-24T12:44:52.839559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834708+0000","last_change":"2024-01-24T12:44:52.825094+0000","last_active":"2024-01-24T12:44:52.834708+0000","last_peered":"2024-01-24T12:44:52.834708+0000","last_clean":"2024-01-24T12:44:52.834708+0000","last_became_active":"2024-01-24T12:44:52.823935+0000","last_became_peered":"2024-01-24T12:44:52.823935+0000","last_unstale":"2024-01-24T12:44:52.834708+0000","last_undegraded":"2024-01-24T12:44:52.834708+0000","last_fullsized":"2024-01-24T12:44:52.834708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796977+0000","last_change":"2024-01-24T12:44:52.836272+0000","last_active":"2024-01-24T12:44:53.796977+0000","last_peered":"2024-01-24T12:44:53.796977+0000","last_clean":"2024-01-24T12:44:53.796977+0000","last_became_active":"2024-01-24T12:44:52.835650+0000","last_became_peered":"2024-01-24T12:44:52.835650+0000","last_unstale":"2024-01-24T12:44:53.796977+0000","last_undegraded":"2024-01-24T12:44:53.796977+0000","last_fullsized":"2024-01-24T12:44:53.796977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.801878+0000","last_change":"2024-01-24T12:44:52.794927+0000","last_active":"2024-01-24T12:44:52.801878+0000","last_peered":"2024-01-24T12:44:52.801878+0000","last_clean":"2024-01-24T12:44:52.801878+0000","last_became_active":"2024-01-24T12:44:52.794659+0000","last_became_peered":"2024-01-24T12:44:52.794659+0000","last_unstale":"2024-01-24T12:44:52.801878+0000","last_undegraded":"2024-01-24T12:44:52.801878+0000","last_fullsized":"2024-01-24T12:44:52.801878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:50:36.218189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.838069+0000","last_change":"2024-01-24T12:44:52.827614+0000","last_active":"2024-01-24T12:44:52.838069+0000","last_peered":"2024-01-24T12:44:52.838069+0000","last_clean":"2024-01-24T12:44:52.838069+0000","last_became_active":"2024-01-24T12:44:52.826766+0000","last_became_peered":"2024-01-24T12:44:52.826766+0000","last_unstale":"2024-01-24T12:44:52.838069+0000","last_undegraded":"2024-01-24T12:44:52.838069+0000","last_fullsized":"2024-01-24T12:44:52.838069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793863+0000","last_change":"2024-01-24T12:44:52.815174+0000","last_active":"2024-01-24T12:44:53.793863+0000","last_peered":"2024-01-24T12:44:53.793863+0000","last_clean":"2024-01-24T12:44:53.793863+0000","last_became_active":"2024-01-24T12:44:52.814111+0000","last_became_peered":"2024-01-24T12:44:52.814111+0000","last_unstale":"2024-01-24T12:44:53.793863+0000","last_undegraded":"2024-01-24T12:44:53.793863+0000","last_fullsized":"2024-01-24T12:44:53.793863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:52:32.483347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133538+0000","last_change":"2024-01-24T12:44:52.795098+0000","last_active":"2024-01-24T12:44:54.133538+0000","last_peered":"2024-01-24T12:44:54.133538+0000","last_clean":"2024-01-24T12:44:54.133538+0000","last_became_active":"2024-01-24T12:44:52.794796+0000","last_became_peered":"2024-01-24T12:44:52.794796+0000","last_unstale":"2024-01-24T12:44:54.133538+0000","last_undegraded":"2024-01-24T12:44:54.133538+0000","last_fullsized":"2024-01-24T12:44:54.133538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:37.182711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.794226+0000","last_change":"2024-01-24T12:44:52.792257+0000","last_active":"2024-01-24T12:44:52.794226+0000","last_peered":"2024-01-24T12:44:52.794226+0000","last_clean":"2024-01-24T12:44:52.794226+0000","last_became_active":"2024-01-24T12:44:52.791950+0000","last_became_peered":"2024-01-24T12:44:52.791950+0000","last_unstale":"2024-01-24T12:44:52.794226+0000","last_undegraded":"2024-01-24T12:44:52.794226+0000","last_fullsized":"2024-01-24T12:44:52.794226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793014+0000","last_change":"2024-01-24T12:44:52.814795+0000","last_active":"2024-01-24T12:44:53.793014+0000","last_peered":"2024-01-24T12:44:53.793014+0000","last_clean":"2024-01-24T12:44:53.793014+0000","last_became_active":"2024-01-24T12:44:52.813586+0000","last_became_peered":"2024-01-24T12:44:52.813586+0000","last_unstale":"2024-01-24T12:44:53.793014+0000","last_undegraded":"2024-01-24T12:44:53.793014+0000","last_fullsized":"2024-01-24T12:44:53.793014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834790+0000","last_change":"2024-01-24T12:44:52.825695+0000","last_active":"2024-01-24T12:44:52.834790+0000","last_peered":"2024-01-24T12:44:52.834790+0000","last_clean":"2024-01-24T12:44:52.834790+0000","last_became_active":"2024-01-24T12:44:52.825037+0000","last_became_peered":"2024-01-24T12:44:52.825037+0000","last_unstale":"2024-01-24T12:44:52.834790+0000","last_undegraded":"2024-01-24T12:44:52.834790+0000","last_fullsized":"2024-01-24T12:44:52.834790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.838192+0000","last_change":"2024-01-24T12:44:52.831194+0000","last_active":"2024-01-24T12:44:52.838192+0000","last_peered":"2024-01-24T12:44:52.838192+0000","last_clean":"2024-01-24T12:44:52.838192+0000","last_became_active":"2024-01-24T12:44:52.830406+0000","last_became_peered":"2024-01-24T12:44:52.830406+0000","last_unstale":"2024-01-24T12:44:52.838192+0000","last_undegraded":"2024-01-24T12:44:52.838192+0000","last_fullsized":"2024-01-24T12:44:52.838192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:32:48.901652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808735+0000","last_change":"2024-01-24T12:44:52.803088+0000","last_active":"2024-01-24T12:44:52.808735+0000","last_peered":"2024-01-24T12:44:52.808735+0000","last_clean":"2024-01-24T12:44:52.808735+0000","last_became_active":"2024-01-24T12:44:52.802782+0000","last_became_peered":"2024-01-24T12:44:52.802782+0000","last_unstale":"2024-01-24T12:44:52.808735+0000","last_undegraded":"2024-01-24T12:44:52.808735+0000","last_fullsized":"2024-01-24T12:44:52.808735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:56:48.995375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808887+0000","last_change":"2024-01-24T12:44:52.803392+0000","last_active":"2024-01-24T12:44:52.808887+0000","last_peered":"2024-01-24T12:44:52.808887+0000","last_clean":"2024-01-24T12:44:52.808887+0000","last_became_active":"2024-01-24T12:44:52.802117+0000","last_became_peered":"2024-01-24T12:44:52.802117+0000","last_unstale":"2024-01-24T12:44:52.808887+0000","last_undegraded":"2024-01-24T12:44:52.808887+0000","last_fullsized":"2024-01-24T12:44:52.808887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133681+0000","last_change":"2024-01-24T12:44:52.815157+0000","last_active":"2024-01-24T12:44:54.133681+0000","last_peered":"2024-01-24T12:44:54.133681+0000","last_clean":"2024-01-24T12:44:54.133681+0000","last_became_active":"2024-01-24T12:44:52.814904+0000","last_became_peered":"2024-01-24T12:44:52.814904+0000","last_unstale":"2024-01-24T12:44:54.133681+0000","last_undegraded":"2024-01-24T12:44:54.133681+0000","last_fullsized":"2024-01-24T12:44:54.133681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:09.851293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795832+0000","last_change":"2024-01-24T12:44:52.808049+0000","last_active":"2024-01-24T12:44:53.795832+0000","last_peered":"2024-01-24T12:44:53.795832+0000","last_clean":"2024-01-24T12:44:53.795832+0000","last_became_active":"2024-01-24T12:44:52.806386+0000","last_became_peered":"2024-01-24T12:44:52.806386+0000","last_unstale":"2024-01-24T12:44:53.795832+0000","last_undegraded":"2024-01-24T12:44:53.795832+0000","last_fullsized":"2024-01-24T12:44:53.795832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:09.270960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795804+0000","last_change":"2024-01-24T12:44:52.830256+0000","last_active":"2024-01-24T12:44:53.795804+0000","last_peered":"2024-01-24T12:44:53.795804+0000","last_clean":"2024-01-24T12:44:53.795804+0000","last_became_active":"2024-01-24T12:44:52.823186+0000","last_became_peered":"2024-01-24T12:44:52.823186+0000","last_unstale":"2024-01-24T12:44:53.795804+0000","last_undegraded":"2024-01-24T12:44:53.795804+0000","last_fullsized":"2024-01-24T12:44:53.795804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:40:12.189291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.821331+0000","last_change":"2024-01-24T12:44:52.818207+0000","last_active":"2024-01-24T12:44:52.821331+0000","last_peered":"2024-01-24T12:44:52.821331+0000","last_clean":"2024-01-24T12:44:52.821331+0000","last_became_active":"2024-01-24T12:44:52.818030+0000","last_became_peered":"2024-01-24T12:44:52.818030+0000","last_unstale":"2024-01-24T12:44:52.821331+0000","last_undegraded":"2024-01-24T12:44:52.821331+0000","last_fullsized":"2024-01-24T12:44:52.821331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:10:09.270960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792721+0000","last_change":"2024-01-24T12:44:52.813715+0000","last_active":"2024-01-24T12:44:53.792721+0000","last_peered":"2024-01-24T12:44:53.792721+0000","last_clean":"2024-01-24T12:44:53.792721+0000","last_became_active":"2024-01-24T12:44:52.812571+0000","last_became_peered":"2024-01-24T12:44:52.812571+0000","last_unstale":"2024-01-24T12:44:53.792721+0000","last_undegraded":"2024-01-24T12:44:53.792721+0000","last_fullsized":"2024-01-24T12:44:53.792721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:26.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.828114+0000","last_change":"2024-01-24T12:44:52.824996+0000","last_active":"2024-01-24T12:44:52.828114+0000","last_peered":"2024-01-24T12:44:52.828114+0000","last_clean":"2024-01-24T12:44:52.828114+0000","last_became_active":"2024-01-24T12:44:52.824721+0000","last_became_peered":"2024-01-24T12:44:52.824721+0000","last_unstale":"2024-01-24T12:44:52.828114+0000","last_undegraded":"2024-01-24T12:44:52.828114+0000","last_fullsized":"2024-01-24T12:44:52.828114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.823188+0000","last_change":"2024-01-24T12:44:52.818416+0000","last_active":"2024-01-24T12:44:52.823188+0000","last_peered":"2024-01-24T12:44:52.823188+0000","last_clean":"2024-01-24T12:44:52.823188+0000","last_became_active":"2024-01-24T12:44:52.818068+0000","last_became_peered":"2024-01-24T12:44:52.818068+0000","last_unstale":"2024-01-24T12:44:52.823188+0000","last_undegraded":"2024-01-24T12:44:52.823188+0000","last_fullsized":"2024-01-24T12:44:52.823188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:58:49.883499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843606+0000","last_change":"2024-01-24T12:44:52.838576+0000","last_active":"2024-01-24T12:44:52.843606+0000","last_peered":"2024-01-24T12:44:52.843606+0000","last_clean":"2024-01-24T12:44:52.843606+0000","last_became_active":"2024-01-24T12:44:52.838239+0000","last_became_peered":"2024-01-24T12:44:52.838239+0000","last_unstale":"2024-01-24T12:44:52.843606+0000","last_undegraded":"2024-01-24T12:44:52.843606+0000","last_fullsized":"2024-01-24T12:44:52.843606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793903+0000","last_change":"2024-01-24T12:44:52.814942+0000","last_active":"2024-01-24T12:44:53.793903+0000","last_peered":"2024-01-24T12:44:53.793903+0000","last_clean":"2024-01-24T12:44:53.793903+0000","last_became_active":"2024-01-24T12:44:52.813261+0000","last_became_peered":"2024-01-24T12:44:52.813261+0000","last_unstale":"2024-01-24T12:44:53.793903+0000","last_undegraded":"2024-01-24T12:44:53.793903+0000","last_fullsized":"2024-01-24T12:44:53.793903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:32:48.901652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795952+0000","last_change":"2024-01-24T12:44:52.808521+0000","last_active":"2024-01-24T12:44:53.795952+0000","last_peered":"2024-01-24T12:44:53.795952+0000","last_clean":"2024-01-24T12:44:53.795952+0000","last_became_active":"2024-01-24T12:44:52.807313+0000","last_became_peered":"2024-01-24T12:44:52.807313+0000","last_unstale":"2024-01-24T12:44:53.795952+0000","last_undegraded":"2024-01-24T12:44:53.795952+0000","last_fullsized":"2024-01-24T12:44:53.795952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839302+0000","last_change":"2024-01-24T12:44:52.831280+0000","last_active":"2024-01-24T12:44:52.839302+0000","last_peered":"2024-01-24T12:44:52.839302+0000","last_clean":"2024-01-24T12:44:52.839302+0000","last_became_active":"2024-01-24T12:44:52.830637+0000","last_became_peered":"2024-01-24T12:44:52.830637+0000","last_unstale":"2024-01-24T12:44:52.839302+0000","last_undegraded":"2024-01-24T12:44:52.839302+0000","last_fullsized":"2024-01-24T12:44:52.839302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795134+0000","last_change":"2024-01-24T12:44:52.809764+0000","last_active":"2024-01-24T12:44:53.795134+0000","last_peered":"2024-01-24T12:44:53.795134+0000","last_clean":"2024-01-24T12:44:53.795134+0000","last_became_active":"2024-01-24T12:44:52.808972+0000","last_became_peered":"2024-01-24T12:44:52.808972+0000","last_unstale":"2024-01-24T12:44:53.795134+0000","last_undegraded":"2024-01-24T12:44:53.795134+0000","last_fullsized":"2024-01-24T12:44:53.795134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:45.334410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.848050+0000","last_change":"2024-01-24T12:44:52.845198+0000","last_active":"2024-01-24T12:44:52.848050+0000","last_peered":"2024-01-24T12:44:52.848050+0000","last_clean":"2024-01-24T12:44:52.848050+0000","last_became_active":"2024-01-24T12:44:52.844517+0000","last_became_peered":"2024-01-24T12:44:52.844517+0000","last_unstale":"2024-01-24T12:44:52.848050+0000","last_undegraded":"2024-01-24T12:44:52.848050+0000","last_fullsized":"2024-01-24T12:44:52.848050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:16:06.837380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.811034+0000","last_change":"2024-01-24T12:44:52.808888+0000","last_active":"2024-01-24T12:44:52.811034+0000","last_peered":"2024-01-24T12:44:52.811034+0000","last_clean":"2024-01-24T12:44:52.811034+0000","last_became_active":"2024-01-24T12:44:52.808566+0000","last_became_peered":"2024-01-24T12:44:52.808566+0000","last_unstale":"2024-01-24T12:44:52.811034+0000","last_undegraded":"2024-01-24T12:44:52.811034+0000","last_fullsized":"2024-01-24T12:44:52.811034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795450+0000","last_change":"2024-01-24T12:44:52.433985+0000","last_active":"2024-01-24T12:44:53.795450+0000","last_peered":"2024-01-24T12:44:53.795450+0000","last_clean":"2024-01-24T12:44:53.795450+0000","last_became_active":"2024-01-24T12:44:52.433396+0000","last_became_peered":"2024-01-24T12:44:52.433396+0000","last_unstale":"2024-01-24T12:44:53.795450+0000","last_undegraded":"2024-01-24T12:44:53.795450+0000","last_fullsized":"2024-01-24T12:44:53.795450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:16.635991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795236+0000","last_change":"2024-01-24T12:44:52.839415+0000","last_active":"2024-01-24T12:44:53.795236+0000","last_peered":"2024-01-24T12:44:53.795236+0000","last_clean":"2024-01-24T12:44:53.795236+0000","last_became_active":"2024-01-24T12:44:52.838773+0000","last_became_peered":"2024-01-24T12:44:52.838773+0000","last_unstale":"2024-01-24T12:44:53.795236+0000","last_undegraded":"2024-01-24T12:44:53.795236+0000","last_fullsized":"2024-01-24T12:44:53.795236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:10.074555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.817894+0000","last_change":"2024-01-24T12:44:52.433057+0000","last_active":"2024-01-24T12:44:52.817894+0000","last_peered":"2024-01-24T12:44:52.817894+0000","last_clean":"2024-01-24T12:44:52.817894+0000","last_became_active":"2024-01-24T12:44:52.432636+0000","last_became_peered":"2024-01-24T12:44:52.432636+0000","last_unstale":"2024-01-24T12:44:52.817894+0000","last_undegraded":"2024-01-24T12:44:52.817894+0000","last_fullsized":"2024-01-24T12:44:52.817894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:11:47.520409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796239+0000","last_change":"2024-01-24T12:44:52.823101+0000","last_active":"2024-01-24T12:44:53.796239+0000","last_peered":"2024-01-24T12:44:53.796239+0000","last_clean":"2024-01-24T12:44:53.796239+0000","last_became_active":"2024-01-24T12:44:52.822303+0000","last_became_peered":"2024-01-24T12:44:52.822303+0000","last_unstale":"2024-01-24T12:44:53.796239+0000","last_undegraded":"2024-01-24T12:44:53.796239+0000","last_fullsized":"2024-01-24T12:44:53.796239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.805387+0000","last_change":"2024-01-24T12:44:52.424153+0000","last_active":"2024-01-24T12:44:52.805387+0000","last_peered":"2024-01-24T12:44:52.805387+0000","last_clean":"2024-01-24T12:44:52.805387+0000","last_became_active":"2024-01-24T12:44:52.423609+0000","last_became_peered":"2024-01-24T12:44:52.423609+0000","last_unstale":"2024-01-24T12:44:52.805387+0000","last_undegraded":"2024-01-24T12:44:52.805387+0000","last_fullsized":"2024-01-24T12:44:52.805387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:36:09.070665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843640+0000","last_change":"2024-01-24T12:44:52.838634+0000","last_active":"2024-01-24T12:44:52.843640+0000","last_peered":"2024-01-24T12:44:52.843640+0000","last_clean":"2024-01-24T12:44:52.843640+0000","last_became_active":"2024-01-24T12:44:52.838334+0000","last_became_peered":"2024-01-24T12:44:52.838334+0000","last_unstale":"2024-01-24T12:44:52.843640+0000","last_undegraded":"2024-01-24T12:44:52.843640+0000","last_fullsized":"2024-01-24T12:44:52.843640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133822+0000","last_change":"2024-01-24T12:44:52.426849+0000","last_active":"2024-01-24T12:44:54.133822+0000","last_peered":"2024-01-24T12:44:54.133822+0000","last_clean":"2024-01-24T12:44:54.133822+0000","last_became_active":"2024-01-24T12:44:52.426573+0000","last_became_peered":"2024-01-24T12:44:52.426573+0000","last_unstale":"2024-01-24T12:44:54.133822+0000","last_undegraded":"2024-01-24T12:44:54.133822+0000","last_fullsized":"2024-01-24T12:44:54.133822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:41:30.217245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.847988+0000","last_change":"2024-01-24T12:44:52.845098+0000","last_active":"2024-01-24T12:44:52.847988+0000","last_peered":"2024-01-24T12:44:52.847988+0000","last_clean":"2024-01-24T12:44:52.847988+0000","last_became_active":"2024-01-24T12:44:52.844471+0000","last_became_peered":"2024-01-24T12:44:52.844471+0000","last_unstale":"2024-01-24T12:44:52.847988+0000","last_undegraded":"2024-01-24T12:44:52.847988+0000","last_fullsized":"2024-01-24T12:44:52.847988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796092+0000","last_change":"2024-01-24T12:44:52.436652+0000","last_active":"2024-01-24T12:44:53.796092+0000","last_peered":"2024-01-24T12:44:53.796092+0000","last_clean":"2024-01-24T12:44:53.796092+0000","last_became_active":"2024-01-24T12:44:52.435053+0000","last_became_peered":"2024-01-24T12:44:52.435053+0000","last_unstale":"2024-01-24T12:44:53.796092+0000","last_undegraded":"2024-01-24T12:44:53.796092+0000","last_fullsized":"2024-01-24T12:44:53.796092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:36.178822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792833+0000","last_change":"2024-01-24T12:44:52.815196+0000","last_active":"2024-01-24T12:44:53.792833+0000","last_peered":"2024-01-24T12:44:53.792833+0000","last_clean":"2024-01-24T12:44:53.792833+0000","last_became_active":"2024-01-24T12:44:52.812733+0000","last_became_peered":"2024-01-24T12:44:52.812733+0000","last_unstale":"2024-01-24T12:44:53.792833+0000","last_undegraded":"2024-01-24T12:44:53.792833+0000","last_fullsized":"2024-01-24T12:44:53.792833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:17:52.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796017+0000","last_change":"2024-01-24T12:44:52.430963+0000","last_active":"2024-01-24T12:44:53.796017+0000","last_peered":"2024-01-24T12:44:53.796017+0000","last_clean":"2024-01-24T12:44:53.796017+0000","last_became_active":"2024-01-24T12:44:52.430166+0000","last_became_peered":"2024-01-24T12:44:52.430166+0000","last_unstale":"2024-01-24T12:44:53.796017+0000","last_undegraded":"2024-01-24T12:44:53.796017+0000","last_fullsized":"2024-01-24T12:44:53.796017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:39:16.635991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793085+0000","last_change":"2024-01-24T12:44:52.807288+0000","last_active":"2024-01-24T12:44:53.793085+0000","last_peered":"2024-01-24T12:44:53.793085+0000","last_clean":"2024-01-24T12:44:53.793085+0000","last_became_active":"2024-01-24T12:44:52.806092+0000","last_became_peered":"2024-01-24T12:44:52.806092+0000","last_unstale":"2024-01-24T12:44:53.793085+0000","last_undegraded":"2024-01-24T12:44:53.793085+0000","last_fullsized":"2024-01-24T12:44:53.793085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786768+0000","last_change":"2024-01-24T12:44:52.422086+0000","last_active":"2024-01-24T12:44:52.786768+0000","last_peered":"2024-01-24T12:44:52.786768+0000","last_clean":"2024-01-24T12:44:52.786768+0000","last_became_active":"2024-01-24T12:44:52.421675+0000","last_became_peered":"2024-01-24T12:44:52.421675+0000","last_unstale":"2024-01-24T12:44:52.786768+0000","last_undegraded":"2024-01-24T12:44:52.786768+0000","last_fullsized":"2024-01-24T12:44:52.786768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:28.355442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.816297+0000","last_change":"2024-01-24T12:44:52.813800+0000","last_active":"2024-01-24T12:44:52.816297+0000","last_peered":"2024-01-24T12:44:52.816297+0000","last_clean":"2024-01-24T12:44:52.816297+0000","last_became_active":"2024-01-24T12:44:52.813479+0000","last_became_peered":"2024-01-24T12:44:52.813479+0000","last_unstale":"2024-01-24T12:44:52.816297+0000","last_undegraded":"2024-01-24T12:44:52.816297+0000","last_fullsized":"2024-01-24T12:44:52.816297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:07:09.667116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794931+0000","last_change":"2024-01-24T12:44:52.429652+0000","last_active":"2024-01-24T12:44:53.794931+0000","last_peered":"2024-01-24T12:44:53.794931+0000","last_clean":"2024-01-24T12:44:53.794931+0000","last_became_active":"2024-01-24T12:44:52.429000+0000","last_became_peered":"2024-01-24T12:44:52.429000+0000","last_unstale":"2024-01-24T12:44:53.794931+0000","last_undegraded":"2024-01-24T12:44:53.794931+0000","last_fullsized":"2024-01-24T12:44:53.794931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:04:34.961071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794433+0000","last_change":"2024-01-24T12:44:52.816644+0000","last_active":"2024-01-24T12:44:53.794433+0000","last_peered":"2024-01-24T12:44:53.794433+0000","last_clean":"2024-01-24T12:44:53.794433+0000","last_became_active":"2024-01-24T12:44:52.815870+0000","last_became_peered":"2024-01-24T12:44:52.815870+0000","last_unstale":"2024-01-24T12:44:53.794433+0000","last_undegraded":"2024-01-24T12:44:53.794433+0000","last_fullsized":"2024-01-24T12:44:53.794433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.787739+0000","last_change":"2024-01-24T12:44:52.430588+0000","last_active":"2024-01-24T12:44:52.787739+0000","last_peered":"2024-01-24T12:44:52.787739+0000","last_clean":"2024-01-24T12:44:52.787739+0000","last_became_active":"2024-01-24T12:44:52.429994+0000","last_became_peered":"2024-01-24T12:44:52.429994+0000","last_unstale":"2024-01-24T12:44:52.787739+0000","last_undegraded":"2024-01-24T12:44:52.787739+0000","last_fullsized":"2024-01-24T12:44:52.787739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:13:29.429181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808758+0000","last_change":"2024-01-24T12:44:52.801855+0000","last_active":"2024-01-24T12:44:52.808758+0000","last_peered":"2024-01-24T12:44:52.808758+0000","last_clean":"2024-01-24T12:44:52.808758+0000","last_became_active":"2024-01-24T12:44:52.801595+0000","last_became_peered":"2024-01-24T12:44:52.801595+0000","last_unstale":"2024-01-24T12:44:52.808758+0000","last_undegraded":"2024-01-24T12:44:52.808758+0000","last_fullsized":"2024-01-24T12:44:52.808758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784717+0000","last_change":"2024-01-24T12:44:52.421233+0000","last_active":"2024-01-24T12:44:52.784717+0000","last_peered":"2024-01-24T12:44:52.784717+0000","last_clean":"2024-01-24T12:44:52.784717+0000","last_became_active":"2024-01-24T12:44:52.418062+0000","last_became_peered":"2024-01-24T12:44:52.418062+0000","last_unstale":"2024-01-24T12:44:52.784717+0000","last_undegraded":"2024-01-24T12:44:52.784717+0000","last_fullsized":"2024-01-24T12:44:52.784717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.810297+0000","last_change":"2024-01-24T12:44:52.805488+0000","last_active":"2024-01-24T12:44:52.810297+0000","last_peered":"2024-01-24T12:44:52.810297+0000","last_clean":"2024-01-24T12:44:52.810297+0000","last_became_active":"2024-01-24T12:44:52.805216+0000","last_became_peered":"2024-01-24T12:44:52.805216+0000","last_unstale":"2024-01-24T12:44:52.810297+0000","last_undegraded":"2024-01-24T12:44:52.810297+0000","last_fullsized":"2024-01-24T12:44:52.810297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:31:15.169650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794300+0000","last_change":"2024-01-24T12:44:52.425453+0000","last_active":"2024-01-24T12:44:53.794300+0000","last_peered":"2024-01-24T12:44:53.794300+0000","last_clean":"2024-01-24T12:44:53.794300+0000","last_became_active":"2024-01-24T12:44:52.424962+0000","last_became_peered":"2024-01-24T12:44:52.424962+0000","last_unstale":"2024-01-24T12:44:53.794300+0000","last_undegraded":"2024-01-24T12:44:53.794300+0000","last_fullsized":"2024-01-24T12:44:53.794300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:25:28.355442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.793834+0000","last_change":"2024-01-24T12:44:52.818770+0000","last_active":"2024-01-24T12:44:53.793834+0000","last_peered":"2024-01-24T12:44:53.793834+0000","last_clean":"2024-01-24T12:44:53.793834+0000","last_became_active":"2024-01-24T12:44:52.817453+0000","last_became_peered":"2024-01-24T12:44:52.817453+0000","last_unstale":"2024-01-24T12:44:53.793834+0000","last_undegraded":"2024-01-24T12:44:53.793834+0000","last_fullsized":"2024-01-24T12:44:53.793834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:04:44.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.846395+0000","last_change":"2024-01-24T12:44:52.424224+0000","last_active":"2024-01-24T12:44:52.846395+0000","last_peered":"2024-01-24T12:44:52.846395+0000","last_clean":"2024-01-24T12:44:52.846395+0000","last_became_active":"2024-01-24T12:44:52.423699+0000","last_became_peered":"2024-01-24T12:44:52.423699+0000","last_unstale":"2024-01-24T12:44:52.846395+0000","last_undegraded":"2024-01-24T12:44:52.846395+0000","last_fullsized":"2024-01-24T12:44:52.846395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:44.330520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.818848+0000","last_change":"2024-01-24T12:44:52.815679+0000","last_active":"2024-01-24T12:44:52.818848+0000","last_peered":"2024-01-24T12:44:52.818848+0000","last_clean":"2024-01-24T12:44:52.818848+0000","last_became_active":"2024-01-24T12:44:52.815448+0000","last_became_peered":"2024-01-24T12:44:52.815448+0000","last_unstale":"2024-01-24T12:44:52.818848+0000","last_undegraded":"2024-01-24T12:44:52.818848+0000","last_fullsized":"2024-01-24T12:44:52.818848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T00:40:12.189291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796200+0000","last_change":"2024-01-24T12:44:52.429840+0000","last_active":"2024-01-24T12:44:53.796200+0000","last_peered":"2024-01-24T12:44:53.796200+0000","last_clean":"2024-01-24T12:44:53.796200+0000","last_became_active":"2024-01-24T12:44:52.428966+0000","last_became_peered":"2024-01-24T12:44:52.428966+0000","last_unstale":"2024-01-24T12:44:53.796200+0000","last_undegraded":"2024-01-24T12:44:53.796200+0000","last_fullsized":"2024-01-24T12:44:53.796200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:08.847403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.801395+0000","last_change":"2024-01-24T12:44:52.793737+0000","last_active":"2024-01-24T12:44:52.801395+0000","last_peered":"2024-01-24T12:44:52.801395+0000","last_clean":"2024-01-24T12:44:52.801395+0000","last_became_active":"2024-01-24T12:44:52.793476+0000","last_became_peered":"2024-01-24T12:44:52.793476+0000","last_unstale":"2024-01-24T12:44:52.801395+0000","last_undegraded":"2024-01-24T12:44:52.801395+0000","last_fullsized":"2024-01-24T12:44:52.801395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T21:21:41.580786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786415+0000","last_change":"2024-01-24T12:44:52.420209+0000","last_active":"2024-01-24T12:44:52.786415+0000","last_peered":"2024-01-24T12:44:52.786415+0000","last_clean":"2024-01-24T12:44:52.786415+0000","last_became_active":"2024-01-24T12:44:52.419813+0000","last_became_peered":"2024-01-24T12:44:52.419813+0000","last_unstale":"2024-01-24T12:44:52.786415+0000","last_undegraded":"2024-01-24T12:44:52.786415+0000","last_fullsized":"2024-01-24T12:44:52.786415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:00.907883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.848092+0000","last_change":"2024-01-24T12:44:52.845243+0000","last_active":"2024-01-24T12:44:52.848092+0000","last_peered":"2024-01-24T12:44:52.848092+0000","last_clean":"2024-01-24T12:44:52.848092+0000","last_became_active":"2024-01-24T12:44:52.844663+0000","last_became_peered":"2024-01-24T12:44:52.844663+0000","last_unstale":"2024-01-24T12:44:52.848092+0000","last_undegraded":"2024-01-24T12:44:52.848092+0000","last_fullsized":"2024-01-24T12:44:52.848092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:20:18.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786650+0000","last_change":"2024-01-24T12:44:52.430759+0000","last_active":"2024-01-24T12:44:52.786650+0000","last_peered":"2024-01-24T12:44:52.786650+0000","last_clean":"2024-01-24T12:44:52.786650+0000","last_became_active":"2024-01-24T12:44:52.430031+0000","last_became_peered":"2024-01-24T12:44:52.430031+0000","last_unstale":"2024-01-24T12:44:52.786650+0000","last_undegraded":"2024-01-24T12:44:52.786650+0000","last_fullsized":"2024-01-24T12:44:52.786650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:00:07.874201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795358+0000","last_change":"2024-01-24T12:44:52.845054+0000","last_active":"2024-01-24T12:44:53.795358+0000","last_peered":"2024-01-24T12:44:53.795358+0000","last_clean":"2024-01-24T12:44:53.795358+0000","last_became_active":"2024-01-24T12:44:52.844430+0000","last_became_peered":"2024-01-24T12:44:52.844430+0000","last_unstale":"2024-01-24T12:44:53.795358+0000","last_undegraded":"2024-01-24T12:44:53.795358+0000","last_fullsized":"2024-01-24T12:44:53.795358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:00:08.878090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809534+0000","last_change":"2024-01-24T12:44:52.427361+0000","last_active":"2024-01-24T12:44:52.809534+0000","last_peered":"2024-01-24T12:44:52.809534+0000","last_clean":"2024-01-24T12:44:52.809534+0000","last_became_active":"2024-01-24T12:44:52.426796+0000","last_became_peered":"2024-01-24T12:44:52.426796+0000","last_unstale":"2024-01-24T12:44:52.809534+0000","last_undegraded":"2024-01-24T12:44:52.809534+0000","last_fullsized":"2024-01-24T12:44:52.809534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:52:31.119010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796525+0000","last_change":"2024-01-24T12:44:52.836399+0000","last_active":"2024-01-24T12:44:53.796525+0000","last_peered":"2024-01-24T12:44:53.796525+0000","last_clean":"2024-01-24T12:44:53.796525+0000","last_became_active":"2024-01-24T12:44:52.835798+0000","last_became_peered":"2024-01-24T12:44:52.835798+0000","last_unstale":"2024-01-24T12:44:53.796525+0000","last_undegraded":"2024-01-24T12:44:53.796525+0000","last_fullsized":"2024-01-24T12:44:53.796525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809134+0000","last_change":"2024-01-24T12:44:52.423144+0000","last_active":"2024-01-24T12:44:52.809134+0000","last_peered":"2024-01-24T12:44:52.809134+0000","last_clean":"2024-01-24T12:44:52.809134+0000","last_became_active":"2024-01-24T12:44:52.422789+0000","last_became_peered":"2024-01-24T12:44:52.422789+0000","last_unstale":"2024-01-24T12:44:52.809134+0000","last_undegraded":"2024-01-24T12:44:52.809134+0000","last_fullsized":"2024-01-24T12:44:52.809134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794243+0000","last_change":"2024-01-24T12:44:52.839056+0000","last_active":"2024-01-24T12:44:53.794243+0000","last_peered":"2024-01-24T12:44:53.794243+0000","last_clean":"2024-01-24T12:44:53.794243+0000","last_became_active":"2024-01-24T12:44:52.838470+0000","last_became_peered":"2024-01-24T12:44:52.838470+0000","last_unstale":"2024-01-24T12:44:53.794243+0000","last_undegraded":"2024-01-24T12:44:53.794243+0000","last_fullsized":"2024-01-24T12:44:53.794243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:53:29.174810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796760+0000","last_change":"2024-01-24T12:44:52.431502+0000","last_active":"2024-01-24T12:44:53.796760+0000","last_peered":"2024-01-24T12:44:53.796760+0000","last_clean":"2024-01-24T12:44:53.796760+0000","last_became_active":"2024-01-24T12:44:52.429328+0000","last_became_peered":"2024-01-24T12:44:52.429328+0000","last_unstale":"2024-01-24T12:44:53.796760+0000","last_undegraded":"2024-01-24T12:44:53.796760+0000","last_fullsized":"2024-01-24T12:44:53.796760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:40.466990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.843636+0000","last_change":"2024-01-24T12:44:52.838605+0000","last_active":"2024-01-24T12:44:52.843636+0000","last_peered":"2024-01-24T12:44:52.843636+0000","last_clean":"2024-01-24T12:44:52.843636+0000","last_became_active":"2024-01-24T12:44:52.838276+0000","last_became_peered":"2024-01-24T12:44:52.838276+0000","last_unstale":"2024-01-24T12:44:52.843636+0000","last_undegraded":"2024-01-24T12:44:52.843636+0000","last_fullsized":"2024-01-24T12:44:52.843636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:51:13.431905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796705+0000","last_change":"2024-01-24T12:44:52.430574+0000","last_active":"2024-01-24T12:44:53.796705+0000","last_peered":"2024-01-24T12:44:53.796705+0000","last_clean":"2024-01-24T12:44:53.796705+0000","last_became_active":"2024-01-24T12:44:52.429095+0000","last_became_peered":"2024-01-24T12:44:52.429095+0000","last_unstale":"2024-01-24T12:44:53.796705+0000","last_undegraded":"2024-01-24T12:44:53.796705+0000","last_fullsized":"2024-01-24T12:44:53.796705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133836+0000","last_change":"2024-01-24T12:44:52.812753+0000","last_active":"2024-01-24T12:44:54.133836+0000","last_peered":"2024-01-24T12:44:54.133836+0000","last_clean":"2024-01-24T12:44:54.133836+0000","last_became_active":"2024-01-24T12:44:52.812378+0000","last_became_peered":"2024-01-24T12:44:52.812378+0000","last_unstale":"2024-01-24T12:44:54.133836+0000","last_undegraded":"2024-01-24T12:44:54.133836+0000","last_fullsized":"2024-01-24T12:44:54.133836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:22.994142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.796358+0000","last_change":"2024-01-24T12:44:52.430168+0000","last_active":"2024-01-24T12:44:53.796358+0000","last_peered":"2024-01-24T12:44:53.796358+0000","last_clean":"2024-01-24T12:44:53.796358+0000","last_became_active":"2024-01-24T12:44:52.429589+0000","last_became_peered":"2024-01-24T12:44:52.429589+0000","last_unstale":"2024-01-24T12:44:53.796358+0000","last_undegraded":"2024-01-24T12:44:53.796358+0000","last_fullsized":"2024-01-24T12:44:53.796358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:37.280528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133454+0000","last_change":"2024-01-24T12:44:52.824252+0000","last_active":"2024-01-24T12:44:54.133454+0000","last_peered":"2024-01-24T12:44:54.133454+0000","last_clean":"2024-01-24T12:44:54.133454+0000","last_became_active":"2024-01-24T12:44:52.824056+0000","last_became_peered":"2024-01-24T12:44:52.824056+0000","last_unstale":"2024-01-24T12:44:54.133454+0000","last_undegraded":"2024-01-24T12:44:54.133454+0000","last_fullsized":"2024-01-24T12:44:54.133454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:38.284418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.804012+0000","last_change":"2024-01-24T12:44:52.409511+0000","last_active":"2024-01-24T12:44:52.804012+0000","last_peered":"2024-01-24T12:44:52.804012+0000","last_clean":"2024-01-24T12:44:52.804012+0000","last_became_active":"2024-01-24T12:44:52.409254+0000","last_became_peered":"2024-01-24T12:44:52.409254+0000","last_unstale":"2024-01-24T12:44:52.804012+0000","last_undegraded":"2024-01-24T12:44:52.804012+0000","last_fullsized":"2024-01-24T12:44:52.804012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133763+0000","last_change":"2024-01-24T12:44:52.794869+0000","last_active":"2024-01-24T12:44:54.133763+0000","last_peered":"2024-01-24T12:44:54.133763+0000","last_clean":"2024-01-24T12:44:54.133763+0000","last_became_active":"2024-01-24T12:44:52.794590+0000","last_became_peered":"2024-01-24T12:44:52.794590+0000","last_unstale":"2024-01-24T12:44:54.133763+0000","last_undegraded":"2024-01-24T12:44:54.133763+0000","last_fullsized":"2024-01-24T12:44:54.133763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:35:44.802079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794773+0000","last_change":"2024-01-24T12:44:52.427918+0000","last_active":"2024-01-24T12:44:53.794773+0000","last_peered":"2024-01-24T12:44:53.794773+0000","last_clean":"2024-01-24T12:44:53.794773+0000","last_became_active":"2024-01-24T12:44:52.427176+0000","last_became_peered":"2024-01-24T12:44:52.427176+0000","last_unstale":"2024-01-24T12:44:53.794773+0000","last_undegraded":"2024-01-24T12:44:53.794773+0000","last_fullsized":"2024-01-24T12:44:53.794773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T14:12:37.280528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133347+0000","last_change":"2024-01-24T12:44:52.794981+0000","last_active":"2024-01-24T12:44:54.133347+0000","last_peered":"2024-01-24T12:44:54.133347+0000","last_clean":"2024-01-24T12:44:54.133347+0000","last_became_active":"2024-01-24T12:44:52.793016+0000","last_became_peered":"2024-01-24T12:44:52.793016+0000","last_unstale":"2024-01-24T12:44:54.133347+0000","last_undegraded":"2024-01-24T12:44:54.133347+0000","last_fullsized":"2024-01-24T12:44:54.133347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T23:04:35.964961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795514+0000","last_change":"2024-01-24T12:44:52.431484+0000","last_active":"2024-01-24T12:44:53.795514+0000","last_peered":"2024-01-24T12:44:53.795514+0000","last_clean":"2024-01-24T12:44:53.795514+0000","last_became_active":"2024-01-24T12:44:52.429933+0000","last_became_peered":"2024-01-24T12:44:52.429933+0000","last_unstale":"2024-01-24T12:44:53.795514+0000","last_undegraded":"2024-01-24T12:44:53.795514+0000","last_fullsized":"2024-01-24T12:44:53.795514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.839522+0000","last_change":"2024-01-24T12:44:52.827998+0000","last_active":"2024-01-24T12:44:52.839522+0000","last_peered":"2024-01-24T12:44:52.839522+0000","last_clean":"2024-01-24T12:44:52.839522+0000","last_became_active":"2024-01-24T12:44:52.827214+0000","last_became_peered":"2024-01-24T12:44:52.827214+0000","last_unstale":"2024-01-24T12:44:52.839522+0000","last_undegraded":"2024-01-24T12:44:52.839522+0000","last_fullsized":"2024-01-24T12:44:52.839522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:05:38.683646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.792963+0000","last_change":"2024-01-24T12:44:52.433392+0000","last_active":"2024-01-24T12:44:53.792963+0000","last_peered":"2024-01-24T12:44:53.792963+0000","last_clean":"2024-01-24T12:44:53.792963+0000","last_became_active":"2024-01-24T12:44:52.432690+0000","last_became_peered":"2024-01-24T12:44:52.432690+0000","last_unstale":"2024-01-24T12:44:53.792963+0000","last_undegraded":"2024-01-24T12:44:53.792963+0000","last_fullsized":"2024-01-24T12:44:53.792963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T15:03:44.330520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:54.133780+0000","last_change":"2024-01-24T12:44:52.831376+0000","last_active":"2024-01-24T12:44:54.133780+0000","last_peered":"2024-01-24T12:44:54.133780+0000","last_clean":"2024-01-24T12:44:54.133780+0000","last_became_active":"2024-01-24T12:44:52.831084+0000","last_became_peered":"2024-01-24T12:44:52.831084+0000","last_unstale":"2024-01-24T12:44:54.133780+0000","last_undegraded":"2024-01-24T12:44:54.133780+0000","last_fullsized":"2024-01-24T12:44:54.133780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:48:41.470880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.835970+0000","last_change":"2024-01-24T12:44:52.417127+0000","last_active":"2024-01-24T12:44:52.835970+0000","last_peered":"2024-01-24T12:44:52.835970+0000","last_clean":"2024-01-24T12:44:52.835970+0000","last_became_active":"2024-01-24T12:44:52.416522+0000","last_became_peered":"2024-01-24T12:44:52.416522+0000","last_unstale":"2024-01-24T12:44:52.835970+0000","last_undegraded":"2024-01-24T12:44:52.835970+0000","last_fullsized":"2024-01-24T12:44:52.835970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:59:59.711645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794342+0000","last_change":"2024-01-24T12:44:52.818779+0000","last_active":"2024-01-24T12:44:53.794342+0000","last_peered":"2024-01-24T12:44:53.794342+0000","last_clean":"2024-01-24T12:44:53.794342+0000","last_became_active":"2024-01-24T12:44:52.815184+0000","last_became_peered":"2024-01-24T12:44:52.815184+0000","last_unstale":"2024-01-24T12:44:53.794342+0000","last_undegraded":"2024-01-24T12:44:53.794342+0000","last_fullsized":"2024-01-24T12:44:53.794342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T17:30:34.488544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784825+0000","last_change":"2024-01-24T12:44:52.409506+0000","last_active":"2024-01-24T12:44:52.784825+0000","last_peered":"2024-01-24T12:44:52.784825+0000","last_clean":"2024-01-24T12:44:52.784825+0000","last_became_active":"2024-01-24T12:44:52.409200+0000","last_became_peered":"2024-01-24T12:44:52.409200+0000","last_unstale":"2024-01-24T12:44:52.784825+0000","last_undegraded":"2024-01-24T12:44:52.784825+0000","last_fullsized":"2024-01-24T12:44:52.784825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.799639+0000","last_change":"2024-01-24T12:44:52.796895+0000","last_active":"2024-01-24T12:44:52.799639+0000","last_peered":"2024-01-24T12:44:52.799639+0000","last_clean":"2024-01-24T12:44:52.799639+0000","last_became_active":"2024-01-24T12:44:52.796610+0000","last_became_peered":"2024-01-24T12:44:52.796610+0000","last_unstale":"2024-01-24T12:44:52.799639+0000","last_undegraded":"2024-01-24T12:44:52.799639+0000","last_fullsized":"2024-01-24T12:44:52.799639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:25:02.968572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786216+0000","last_change":"2024-01-24T12:44:52.419588+0000","last_active":"2024-01-24T12:44:52.786216+0000","last_peered":"2024-01-24T12:44:52.786216+0000","last_clean":"2024-01-24T12:44:52.786216+0000","last_became_active":"2024-01-24T12:44:52.419174+0000","last_became_peered":"2024-01-24T12:44:52.419174+0000","last_unstale":"2024-01-24T12:44:52.786216+0000","last_undegraded":"2024-01-24T12:44:52.786216+0000","last_fullsized":"2024-01-24T12:44:52.786216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:33:36.178822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794695+0000","last_change":"2024-01-24T12:44:52.806136+0000","last_active":"2024-01-24T12:44:53.794695+0000","last_peered":"2024-01-24T12:44:53.794695+0000","last_clean":"2024-01-24T12:44:53.794695+0000","last_became_active":"2024-01-24T12:44:52.805013+0000","last_became_peered":"2024-01-24T12:44:52.805013+0000","last_unstale":"2024-01-24T12:44:53.794695+0000","last_undegraded":"2024-01-24T12:44:53.794695+0000","last_fullsized":"2024-01-24T12:44:53.794695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:01.911773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.784697+0000","last_change":"2024-01-24T12:44:52.412347+0000","last_active":"2024-01-24T12:44:52.784697+0000","last_peered":"2024-01-24T12:44:52.784697+0000","last_clean":"2024-01-24T12:44:52.784697+0000","last_became_active":"2024-01-24T12:44:52.411771+0000","last_became_peered":"2024-01-24T12:44:52.411771+0000","last_unstale":"2024-01-24T12:44:52.784697+0000","last_undegraded":"2024-01-24T12:44:52.784697+0000","last_fullsized":"2024-01-24T12:44:52.784697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:11:00.907883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.809188+0000","last_change":"2024-01-24T12:44:52.806757+0000","last_active":"2024-01-24T12:44:52.809188+0000","last_peered":"2024-01-24T12:44:52.809188+0000","last_clean":"2024-01-24T12:44:52.809188+0000","last_became_active":"2024-01-24T12:44:52.806563+0000","last_became_peered":"2024-01-24T12:44:52.806563+0000","last_unstale":"2024-01-24T12:44:52.809188+0000","last_undegraded":"2024-01-24T12:44:52.809188+0000","last_fullsized":"2024-01-24T12:44:52.809188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:03.123823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786521+0000","last_change":"2024-01-24T12:44:52.417102+0000","last_active":"2024-01-24T12:44:52.786521+0000","last_peered":"2024-01-24T12:44:52.786521+0000","last_clean":"2024-01-24T12:44:52.786521+0000","last_became_active":"2024-01-24T12:44:52.416379+0000","last_became_peered":"2024-01-24T12:44:52.416379+0000","last_unstale":"2024-01-24T12:44:52.786521+0000","last_undegraded":"2024-01-24T12:44:52.786521+0000","last_fullsized":"2024-01-24T12:44:52.786521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:50:12.088065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.808547+0000","last_change":"2024-01-24T12:44:52.801774+0000","last_active":"2024-01-24T12:44:52.808547+0000","last_peered":"2024-01-24T12:44:52.808547+0000","last_clean":"2024-01-24T12:44:52.808547+0000","last_became_active":"2024-01-24T12:44:52.801490+0000","last_became_peered":"2024-01-24T12:44:52.801490+0000","last_unstale":"2024-01-24T12:44:52.808547+0000","last_undegraded":"2024-01-24T12:44:52.808547+0000","last_fullsized":"2024-01-24T12:44:52.808547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T12:53:29.174810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795640+0000","last_change":"2024-01-24T12:44:52.429430+0000","last_active":"2024-01-24T12:44:53.795640+0000","last_peered":"2024-01-24T12:44:53.795640+0000","last_clean":"2024-01-24T12:44:53.795640+0000","last_became_active":"2024-01-24T12:44:52.428797+0000","last_became_peered":"2024-01-24T12:44:52.428797+0000","last_unstale":"2024-01-24T12:44:53.795640+0000","last_undegraded":"2024-01-24T12:44:53.795640+0000","last_fullsized":"2024-01-24T12:44:53.795640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:21:21.990252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.795263+0000","last_change":"2024-01-24T12:44:52.828166+0000","last_active":"2024-01-24T12:44:53.795263+0000","last_peered":"2024-01-24T12:44:53.795263+0000","last_clean":"2024-01-24T12:44:53.795263+0000","last_became_active":"2024-01-24T12:44:52.822844+0000","last_became_peered":"2024-01-24T12:44:52.822844+0000","last_unstale":"2024-01-24T12:44:53.795263+0000","last_undegraded":"2024-01-24T12:44:53.795263+0000","last_fullsized":"2024-01-24T12:44:53.795263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T16:36:55.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.786758+0000","last_change":"2024-01-24T12:44:52.433515+0000","last_active":"2024-01-24T12:44:52.786758+0000","last_peered":"2024-01-24T12:44:52.786758+0000","last_clean":"2024-01-24T12:44:52.786758+0000","last_became_active":"2024-01-24T12:44:52.432943+0000","last_became_peered":"2024-01-24T12:44:52.432943+0000","last_unstale":"2024-01-24T12:44:52.786758+0000","last_undegraded":"2024-01-24T12:44:52.786758+0000","last_fullsized":"2024-01-24T12:44:52.786758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T13:53:02.119933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.834777+0000","last_change":"2024-01-24T12:44:52.825997+0000","last_active":"2024-01-24T12:44:52.834777+0000","last_peered":"2024-01-24T12:44:52.834777+0000","last_clean":"2024-01-24T12:44:52.834777+0000","last_became_active":"2024-01-24T12:44:52.825320+0000","last_became_peered":"2024-01-24T12:44:52.825320+0000","last_unstale":"2024-01-24T12:44:52.834777+0000","last_undegraded":"2024-01-24T12:44:52.834777+0000","last_fullsized":"2024-01-24T12:44:52.834777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:52.383266+0000","last_clean_scrub_stamp":"2024-01-24T12:44:52.383266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T18:48:41.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T12:44:53.794541+0000","last_change":"2024-01-24T12:44:52.438025+0000","last_active":"2024-01-24T12:44:53.794541+0000","last_peered":"2024-01-24T12:44:53.794541+0000","last_clean":"2024-01-24T12:44:53.794541+0000","last_became_active":"2024-01-24T12:44:52.437498+0000","last_became_peered":"2024-01-24T12:44:52.437498+0000","last_unstale":"2024-01-24T12:44:53.794541+0000","last_undegraded":"2024-01-24T12:44:53.794541+0000","last_fullsized":"2024-01-24T12:44:53.794541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:44:51.379376+0000","last_clean_scrub_stamp":"2024-01-24T12:44:51.379376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T20:28:08.847403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-24T12:44:52.430759+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T12:44:52.430759+0000","last_peered":"2024-01-24T12:44:52.430759+0000","last_clean":"2024-01-24T12:44:52.430759+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T12:44:52.430759+0000","last_undegraded":"2024-01-24T12:44:52.430759+0000","last_fullsized":"2024-01-24T12:44:52.430759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":718420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":718330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T12:44:56.164 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-24T12:44:56.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-24T12:44:56.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 Processor -- start 2024-01-24T12:44:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 -- start start 2024-01-24T12:44:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfcc148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fdfcc0b3320 0x7fdfcc149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc148a80 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3890 con 0x7fdfcc0b3320 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd3acb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3b70 con 0x7fdfcc0b8540 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd1867640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdfcc0b8df0 0x7fdfcc142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60154/0 (socket says 172.21.15.27:60154) 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd1867640 1 -- 172.21.15.27:0/1369126784 learned_addr learned my addr 172.21.15.27:0/1369126784 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd2068640 1 --2- 172.21.15.27:0/1369126784 >> v2:172.21.15.124:3300/0 conn(0x7fdfcc0b3320 0x7fdfcc149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd1066640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfcc148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5080641 0 0) 0x7fdfcc148a80 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8003530 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699394011 0 0) 0x7fdfb8003530 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 msgr2=0x7fdfcc148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfcc148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 >> v2:172.21.15.124:3300/0 conn(0x7fdfcc0b3320 msgr2=0x7fdfcc149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 --2- 172.21.15.27:0/1369126784 >> v2:172.21.15.124:3300/0 conn(0x7fdfcc0b3320 0x7fdfcc149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0b3e50 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fdfc8001680 con 0x7fdfcc0b8df0 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 >> v1:172.21.15.27:6789/0 conn(0x7fdfcc0b8df0 legacy=0x7fdfcc142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfb8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfb8003f00 0x7fdfb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfb8004d10 0x7fdfb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3890 con 0x7fdfb8003f00 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0b3b70 con 0x7fdfb8004d10 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb800b990 con 0x7fdfcc0b8540 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.334+0000 7fdfd1066640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfb8003f00 0x7fdfb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd2068640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfb8004d10 0x7fdfb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1867640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfb8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 -- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 msgr2=0x7fdfb8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfcc0b8540 0x7fdfb8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 -- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfb8004d10 msgr2=0x7fdfb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfb8004d10 0x7fdfb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 -- 172.21.15.27:0/1369126784 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8003530 con 0x7fdfb8003f00 2024-01-24T12:44:56.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd2068640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfb8004d10 0x7fdfb8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd1066640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfb8003f00 0x7fdfb80047d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ae0 tx=0x7fdfbc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6f7a12cfb27644 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5530 con 0x7fdfb8003f00 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a5690 con 0x7fdfb8003f00 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd0865640 1 -- 172.21.15.27:0/1369126784 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5a40 con 0x7fdfb8003f00 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 -- 172.21.15.27:0/1369126784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfb8003f00 msgr2=0x7fdfb80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/1369126784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfb8003f00 0x7fdfb80047d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ae0 tx=0x7fdfbc01c9f0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd2068640 1 -- 172.21.15.27:0/1369126784 reap_dead start 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 -- 172.21.15.27:0/1369126784 shutdown_connections 2024-01-24T12:44:56.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 -- 172.21.15.27:0/1369126784 >> 172.21.15.27:0/1369126784 conn(0x7fdfcc06a120 msgr2=0x7fdfcc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 -- 172.21.15.27:0/1369126784 shutdown_connections 2024-01-24T12:44:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.338+0000 7fdfd3acb640 1 -- 172.21.15.27:0/1369126784 wait complete. 2024-01-24T12:44:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 Processor -- start 2024-01-24T12:44:56.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- start start 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 0x7fdfcc145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfcc13a490 0x7fdfcc13a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc145660 con 0x7fdfcc1cea90 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0bcae0 con 0x7fdfcc13a490 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1d5700 con 0x7fdfb8003f00 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50480/0 (socket says 172.21.15.27:50480) 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 -- 172.21.15.27:0/3137328462 learned_addr learned my addr 172.21.15.27:0/3137328462 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd2068640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfcc13a490 0x7fdfcc13a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1867640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 0x7fdfcc145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 -- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 msgr2=0x7fdfcc145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 0x7fdfcc145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 -- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfcc13a490 msgr2=0x7fdfcc13a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfcc13a490 0x7fdfcc13a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 -- 172.21.15.27:0/3137328462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc143ba0 con 0x7fdfcc1cea90 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1867640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 0x7fdfcc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd1066640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ae0 tx=0x7fdfb8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004220 con 0x7fdfcc1cea90 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc004380 con 0x7fdfcc1cea90 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc143e80 con 0x7fdfcc1cea90 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ad850 con 0x7fdfcc1cea90 2024-01-24T12:44:56.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc1cef10 con 0x7fdfcc1cea90 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc04e000 con 0x7fdfcc1cea90 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdfbc0b4040 con 0x7fdfcc1cea90 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 0x7fdfb0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.342+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfbc11d770 con 0x7fdfcc1cea90 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.346+0000 7fdfd1867640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 0x7fdfb0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.346+0000 7fdfd1867640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 0x7fdfb0067f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8001cc0 tx=0x7fdfc8001c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.346+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdfbc0eb2f0 con 0x7fdfcc1cea90 2024-01-24T12:44:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.554+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdfcc0bcc20 con 0x7fdfcc1cea90 2024-01-24T12:44:56.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.562+0000 7fdfc27fc640 1 -- 172.21.15.27:0/3137328462 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdfbc0ee910 con 0x7fdfcc1cea90 2024-01-24T12:44:56.565 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 msgr2=0x7fdfb0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 0x7fdfb0067f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8001cc0 tx=0x7fdfc8001c50 comp rx=0 tx=0).stop 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 msgr2=0x7fdfcc1443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009ae0 tx=0x7fdfb8005800 comp rx=0 tx=0).stop 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 shutdown_connections 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdfb0065a90 0x7fdfb0067f50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdfcc13a490 0x7fdfcc13a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfcc1cea90 0x7fdfcc1443a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 --2- 172.21.15.27:0/3137328462 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdfb8003f00 0x7fdfcc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 >> 172.21.15.27:0/3137328462 conn(0x7fdfcc06a120 msgr2=0x7fdfcc1466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 shutdown_connections 2024-01-24T12:44:56.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.566+0000 7fdfd3acb640 1 -- 172.21.15.27:0/3137328462 wait complete. 2024-01-24T12:44:56.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T12:44:56.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 Processor -- start 2024-01-24T12:44:56.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 -- start start 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72200bc340 0x7f72201415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 0x7f7220147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f72201481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7220071550 con 0x7f72200bc340 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7220071810 con 0x7f7220141b30 2024-01-24T12:44:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.694+0000 7f72260c3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72200bc720 con 0x7f72200b8020 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72200bc340 0x7f72201415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f72200bc340 0x7f72201415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50492/0 (socket says 172.21.15.27:50492) 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 -- 172.21.15.27:0/1325242949 learned_addr learned my addr 172.21.15.27:0/1325242949 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721ffff640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f72201481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721effd640 1 --2- 172.21.15.27:0/1325242949 >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 0x7f7220147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 -- 172.21.15.27:0/1325242949 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 msgr2=0x7f72201481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f72201481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 -- 172.21.15.27:0/1325242949 >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 msgr2=0x7f7220147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 --2- 172.21.15.27:0/1325242949 >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 0x7f7220147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 -- 172.21.15.27:0/1325242949 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200b2d90 con 0x7f72200bc340 2024-01-24T12:44:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721effd640 1 --2- 172.21.15.27:0/1325242949 >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 0x7f7220147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:56.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721f7fe640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f72201415f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f722006b260 tx=0x7f721001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229591ed08e91c48 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721e7fc640 1 -- 172.21.15.27:0/1325242949 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ab600 con 0x7f72200bc340 2024-01-24T12:44:56.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721e7fc640 1 -- 172.21.15.27:0/1325242949 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100a7050 con 0x7f72200bc340 2024-01-24T12:44:56.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.698+0000 7f721e7fc640 1 -- 172.21.15.27:0/1325242949 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ab980 con 0x7f72200bc340 2024-01-24T12:44:56.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/1325242949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 msgr2=0x7f72201415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f72201415f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f722006b260 tx=0x7f721001c470 comp rx=0 tx=0).stop 2024-01-24T12:44:56.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/1325242949 shutdown_connections 2024-01-24T12:44:56.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- 172.21.15.27:0/1325242949 >> v2:172.21.15.124:3300/0 conn(0x7f7220141b30 0x7f7220147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f72201481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- 172.21.15.27:0/1325242949 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f72201415f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/1325242949 >> 172.21.15.27:0/1325242949 conn(0x7f7220069ef0 msgr2=0x7f722006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/1325242949 shutdown_connections 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/1325242949 wait complete. 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 Processor -- start 2024-01-24T12:44:56.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- start start 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f7220132ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 0x7f722012e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72200b26b0 con 0x7f72200bc340 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722012ee20 con 0x7f7220141b30 2024-01-24T12:44:56.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722014a490 con 0x7f72200b8020 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50494/0 (socket says 172.21.15.27:50494) 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 -- 172.21.15.27:0/3576404424 learned_addr learned my addr 172.21.15.27:0/3576404424 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721f7fe640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f7220132ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721ffff640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 0x7f722012e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 -- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 msgr2=0x7f7220132ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f7220132ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 -- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 msgr2=0x7f722012e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 0x7f722012e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 -- 172.21.15.27:0/3576404424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100094d0 con 0x7f72200bc340 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721ffff640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 0x7f722012e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f721effd640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f721400ead0 tx=0x7f721400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214007c10 con 0x7f72200bc340 2024-01-24T12:44:56.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214007d70 con 0x7f72200bc340 2024-01-24T12:44:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722014a770 con 0x7f72200bc340 2024-01-24T12:44:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214010660 con 0x7f72200bc340 2024-01-24T12:44:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.702+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722014a180 con 0x7f72200bc340 2024-01-24T12:44:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722004e000 con 0x7f72200bc340 2024-01-24T12:44:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f72140107c0 con 0x7f72200bc340 2024-01-24T12:44:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f7207fff640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 0x7f720c067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7214014070 con 0x7f72200bc340 2024-01-24T12:44:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f721f7fe640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 0x7f720c067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:56.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.706+0000 7f721f7fe640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 0x7f720c067ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72100ad000 tx=0x7f7210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.710+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f72140500b0 con 0x7f72200bc340 2024-01-24T12:44:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.894+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f722006a600 con 0x7f72200bc340 2024-01-24T12:44:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.894+0000 7f7207fff640 1 -- 172.21.15.27:0/3576404424 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7f7214053090 con 0x7f72200bc340 2024-01-24T12:44:56.898 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:44:56.898 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T12:44:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 msgr2=0x7f720c067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 0x7f720c067ef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72100ad000 tx=0x7f7210008040 comp rx=0 tx=0).stop 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 msgr2=0x7f722012f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f721400ead0 tx=0x7f721400ef90 comp rx=0 tx=0).stop 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 shutdown_connections 2024-01-24T12:44:56.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f720c065a30 0x7f720c067ef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7220141b30 0x7f722012e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f72200bc340 0x7f722012f590 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 --2- 172.21.15.27:0/3576404424 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f72200b8020 0x7f7220132ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 >> 172.21.15.27:0/3576404424 conn(0x7f7220069ef0 msgr2=0x7f7220137ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 shutdown_connections 2024-01-24T12:44:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:56.898+0000 7f72260c3640 1 -- 172.21.15.27:0/3576404424 wait complete. 2024-01-24T12:44:57.176 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T12:44:57.174+0000 7ff79f756640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T12:44:57.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-24T12:44:52.773516+0000', 'modified': '2024-01-24T12:44:54.787781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/555930639', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 555930639}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 555930639}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-24T12:44:57.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-24T12:44:57.220 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-24T12:44:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 Processor -- start 2024-01-24T12:44:57.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 -- start start 2024-01-24T12:44:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b0071160 0x7ff6b00b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b00b3c40 con 0x7ff6b00b42d0 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b00b4720 con 0x7ff6b01429f0 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b779b640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00b5140 con 0x7ff6b0071160 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.350+0000 7ff6b5537640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b0071160 0x7ff6b00b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b4d36640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff6b00b42d0 0x7ff6b00b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60158/0 (socket says 172.21.15.27:60158) 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b5537640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b0071160 0x7ff6b00b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50508/0 (socket says 172.21.15.27:50508) 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b4d36640 1 -- 172.21.15.27:0/1370799338 learned_addr learned my addr 172.21.15.27:0/1370799338 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b5537640 1 -- 172.21.15.27:0/1370799338 >> v1:172.21.15.124:6789/0 conn(0x7ff6b01429f0 legacy=0x7ff6b0153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b5537640 1 -- 172.21.15.27:0/1370799338 >> v1:172.21.15.27:6789/0 conn(0x7ff6b00b42d0 legacy=0x7ff6b00b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b5537640 1 -- 172.21.15.27:0/1370799338 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00b9f60 con 0x7ff6b0071160 2024-01-24T12:44:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6a7fff640 1 -- 172.21.15.27:0/1370799338 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258351029 0 0) 0x7ff6b00b3c40 con 0x7ff6b00b42d0 2024-01-24T12:44:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b5537640 1 --2- 172.21.15.27:0/1370799338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b0071160 0x7ff6b00b9900 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0097c0 tx=0x7ff6ac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f147373b3052a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6a7fff640 1 -- 172.21.15.27:0/1370799338 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0ac640 con 0x7ff6b0071160 2024-01-24T12:44:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6a7fff640 1 -- 172.21.15.27:0/1370799338 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0ac7a0 con 0x7ff6b0071160 2024-01-24T12:44:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6a7fff640 1 -- 172.21.15.27:0/1370799338 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0acb30 con 0x7ff6b0071160 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 -- 172.21.15.27:0/1370799338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b0071160 msgr2=0x7ff6b00b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 --2- 172.21.15.27:0/1370799338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b0071160 0x7ff6b00b9900 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0097c0 tx=0x7ff6ac01c3c0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 -- 172.21.15.27:0/1370799338 shutdown_connections 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 --2- 172.21.15.27:0/1370799338 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b0071160 0x7ff6b00b9900 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 -- 172.21.15.27:0/1370799338 >> 172.21.15.27:0/1370799338 conn(0x7ff6b00be150 msgr2=0x7ff6b00be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 -- 172.21.15.27:0/1370799338 shutdown_connections 2024-01-24T12:44:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.354+0000 7ff6b779b640 1 -- 172.21.15.27:0/1370799338 wait complete. 2024-01-24T12:44:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 Processor -- start 2024-01-24T12:44:57.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- start start 2024-01-24T12:44:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff6b0071160 0x7ff6b0148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff6b01429f0 0x7ff6b0146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0148780 con 0x7ff6b00b42d0 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01e23d0 con 0x7ff6b0071160 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01496a0 con 0x7ff6b01429f0 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b5537640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff6b0071160 0x7ff6b0148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50514/0 (socket says 172.21.15.27:50514) 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3551466275 learned_addr learned my addr 172.21.15.27:0/3551466275 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff6b01429f0 0x7ff6b0146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff6b01429f0 msgr2=0x7ff6b0146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff6b01429f0 0x7ff6b0146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff6b0071160 msgr2=0x7ff6b0148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff6b0071160 0x7ff6b0148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3551466275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009420 con 0x7ff6b00b42d0 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c4a0 tx=0x7ff6a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6a5ffb640 1 -- 172.21.15.27:0/3551466275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00074e0 con 0x7ff6b00b42d0 2024-01-24T12:44:57.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6a5ffb640 1 -- 172.21.15.27:0/3551466275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0007640 con 0x7ff6b00b42d0 2024-01-24T12:44:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b01e1aa0 con 0x7ff6b00b42d0 2024-01-24T12:44:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6a5ffb640 1 -- 172.21.15.27:0/3551466275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004a10 con 0x7ff6b00b42d0 2024-01-24T12:44:57.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.358+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b01e2060 con 0x7ff6b00b42d0 2024-01-24T12:44:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6a5ffb640 1 -- 172.21.15.27:0/3551466275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6a0004b70 con 0x7ff6b00b42d0 2024-01-24T12:44:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6a5ffb640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 0x7ff694067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6a5ffb640 1 -- 172.21.15.27:0/3551466275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a0082210 con 0x7ff6b00b42d0 2024-01-24T12:44:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 0x7ff694067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 Processor -- start 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- start start 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 0x7ff694067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0ae000 tx=0x7ff6ac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 0x561b549067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b549116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54727350 con 0x561b548d8a90 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54724920 con 0x561b54906d30 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54720210 con 0x561b54906410 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50520/0 (socket says 172.21.15.27:50520) 2024-01-24T12:44:57.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 -- 172.21.15.27:0/1894825009 learned_addr learned my addr 172.21.15.27:0/1894825009 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b549116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 0x561b549067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 -- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 msgr2=0x561b549067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 0x561b549067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 -- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 msgr2=0x561b549116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b549116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 -- 172.21.15.27:0/1894825009 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b546c0ff0 con 0x561b548d8a90 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 0x561b549067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:57.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6b5537640 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0097c0 tx=0x7ff6ac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedf31c662ffc7db server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff69affd640 1 -- 172.21.15.27:0/1894825009 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0b7b40 con 0x561b548d8a90 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff69affd640 1 -- 172.21.15.27:0/1894825009 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0b7ca0 con 0x561b548d8a90 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff69affd640 1 -- 172.21.15.27:0/1894825009 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0cc660 con 0x561b548d8a90 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/1894825009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 msgr2=0x561b549048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0097c0 tx=0x7ff6ac004740 comp rx=0 tx=0).stop 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/1894825009 shutdown_connections 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b549116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906410 0x561b549067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/1894825009 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b548d8a90 0x561b549048e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/1894825009 >> 172.21.15.27:0/1894825009 conn(0x561b547d5430 msgr2=0x561b549041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/1894825009 shutdown_connections 2024-01-24T12:44:57.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/1894825009 wait complete. 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 -- start start 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.362+0000 7ff6ba8c4000 1 Processor -- start 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906410 0x561b548d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b546bf420 con 0x561b54906d30 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b546dd890 con 0x561b54906410 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b543dd940 con 0x561b548d8a90 2024-01-24T12:44:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 10 client.0 _ll_register_callbacks cb 0x561b54714f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50536/0 (socket says 172.21.15.27:50536) 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 -- 172.21.15.27:0/203091614 learned_addr learned my addr 172.21.15.27:0/203091614 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5537640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906410 0x561b548d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 -- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 msgr2=0x561b548d7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 -- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906410 msgr2=0x561b548d7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906410 0x561b548d7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 -- 172.21.15.27:0/203091614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b00b9f60 con 0x561b54906d30 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005730 tx=0x7ff6a8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71002a7dc0029a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8003b30 con 0x561b54906d30 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a8013600 con 0x561b54906d30 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b546e5cc0 con 0x561b54906d30 2024-01-24T12:44:57.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a8013800 con 0x561b54906d30 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 10 client.5151 fetch_fsmap learned FSMap version 13 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561b5441c890 con 0x561b54906d30 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b546e5cc0 con 0x561b54906d30 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ff6a8013960 con 0x561b54906d30 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 10 client.5151 fetch_fsmap finished waiting for FSMap version 13 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 10 client.5151 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-24T12:44:57.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 20 client.5151 populate_metadata read hostname 'smithi027' 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5491a4f0 0x561b5491c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 4 client.5151 mds_command: new command op to 4968 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 --> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b5471eb60 con 0x561b5491a4f0 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5537640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5491a4f0 0x561b5491c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6b5537640 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5491a4f0 0x561b5491c8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a00cd384d657bc server_cookie=6a96f3b20e5a08a in_seq=0 out_seq=0 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 10 client.5151 ms_handle_connect on v2:172.21.15.27:6833/555930639 2024-01-24T12:44:57.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 1 -- 172.21.15.27:0/203091614 <== mds.0 v2:172.21.15.27:6833/555930639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561b5471eb60 con 0x561b5491a4f0 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 10 client.5151 handle_command_reply: tid=0 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 client.5151 shutdown 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 msgr2=0x561b548d7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005730 tx=0x7ff6a8001c70 comp rx=0 tx=0).stop 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 shutdown_connections 2024-01-24T12:44:57.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5491a4f0 0x561b5491c8e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906d30 0x561b548d7b80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906410 0x561b548d7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/203091614 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 >> 172.21.15.27:0/203091614 conn(0x561b547d5430 msgr2=0x561b548cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff68ffff640 0 client.5151 ms_handle_reset on v2:172.21.15.27:6833/555930639 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 shutdown_connections 2024-01-24T12:44:57.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/203091614 wait complete. 2024-01-24T12:44:57.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.366+0000 7ff6ba8c4000 20 client.5151 trim_cache size 0 max 16384 2024-01-24T12:44:57.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 Processor -- start 2024-01-24T12:44:57.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 -- start start 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b548d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b548c9c60 con 0x561b54906410 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54740080 con 0x561b54906d30 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54720ac0 con 0x561b548d8a90 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50540/0 (socket says 172.21.15.27:50540) 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 -- 172.21.15.27:0/143503783 learned_addr learned my addr 172.21.15.27:0/143503783 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b5537640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b548d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 -- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 msgr2=0x561b548d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 -- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 msgr2=0x561b548d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b548d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 -- 172.21.15.27:0/143503783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b546e52d0 con 0x561b54906410 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b548d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.382+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00807f0 tx=0x7ff6a004fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f46c5d0e1afd535 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff69b7fe640 1 -- 172.21.15.27:0/143503783 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0053950 con 0x561b54906410 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff69b7fe640 1 -- 172.21.15.27:0/143503783 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a006d020 con 0x561b54906410 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff69b7fe640 1 -- 172.21.15.27:0/143503783 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00576d0 con 0x561b54906410 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/143503783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 msgr2=0x561b548cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00807f0 tx=0x7ff6a004fc90 comp rx=0 tx=0).stop 2024-01-24T12:44:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/143503783 shutdown_connections 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b54906d30 0x561b548d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b548cff60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/143503783 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b548d8a90 0x561b548d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/143503783 >> 172.21.15.27:0/143503783 conn(0x561b547d5430 msgr2=0x561b54903870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/143503783 shutdown_connections 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/143503783 wait complete. 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- start start 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 Processor -- start 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b548d8a90 0x561b54932a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 0x561b549334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b548a1470 con 0x561b54906410 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b547a8f00 con 0x561b548d8a90 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b546c83a0 con 0x561b54906d30 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 10 client.0 _ll_register_callbacks cb 0x561b547708d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50548/0 (socket says 172.21.15.27:50548) 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3605003330 learned_addr learned my addr 172.21.15.27:0/3605003330 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b5537640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b548d8a90 0x561b54932a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 0x561b549334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 msgr2=0x561b549334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 0x561b549334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b548d8a90 msgr2=0x561b54932a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b548d8a90 0x561b54932a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 -- 172.21.15.27:0/3605003330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b01e2060 con 0x561b54906410 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b5d38640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 0x561b549334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b4d36640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff6a004fe50 tx=0x7ff6a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59056372fd73fa27 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-24T12:44:57.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a007e060 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a006e070 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b546d9a00 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a0053950 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 10 client.5157 fetch_fsmap learned FSMap version 13 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561b546cb420 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0075070 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ff6a0080270 con 0x561b54906410 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 10 client.5157 fetch_fsmap finished waiting for FSMap version 13 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 10 client.5157 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-24T12:44:57.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 20 client.5157 populate_metadata read hostname 'smithi027' 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5496c6a0 0x561b5496ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 4 client.5157 mds_command: new command op to 4968 tid=0[{"prefix": "status"}] 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 --> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561b54719290 con 0x561b5496c6a0 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b5537640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5496c6a0 0x561b5496ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff68ffff640 10 client.5157 ms_handle_connect on v2:172.21.15.27:6833/555930639 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.386+0000 7ff6b5537640 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5496c6a0 0x561b5496ea90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94f62c61081a0b0 server_cookie=94ec66138493e070 in_seq=0 out_seq=0 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff68ffff640 1 -- 172.21.15.27:0/3605003330 <== mds.0 v2:172.21.15.27:6833/555930639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x561b54719290 con 0x561b5496c6a0 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff68ffff640 10 client.5157 handle_command_reply: tid=0 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 client.5157 shutdown 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 msgr2=0x561b54932f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff6a004fe50 tx=0x7ff6a000cf90 comp rx=0 tx=0).stop 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 shutdown_connections 2024-01-24T12:44:57.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:6833/555930639,v1:172.21.15.27:6835/555930639] conn(0x561b5496c6a0 0x561b5496ea90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x561b54906d30 0x561b549334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff68ffff640 0 client.5157 ms_handle_reset on v2:172.21.15.27:6833/555930639 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x561b54906410 0x561b54932f90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 --2- 172.21.15.27:0/3605003330 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x561b548d8a90 0x561b54932a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 >> 172.21.15.27:0/3605003330 conn(0x561b547d5430 msgr2=0x561b54903870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 shutdown_connections 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 1 -- 172.21.15.27:0/3605003330 wait complete. 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6ba8c4000 20 client.5157 trim_cache size 0 max 16384 2024-01-24T12:44:57.401 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98", 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4968, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 4.6145831309999998, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 13, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 31, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 31, 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 11.060147251 2024-01-24T12:44:57.402 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 msgr2=0x7ff694067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 0x7ff694067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0ae000 tx=0x7ff6ac0a7000 comp rx=0 tx=0).stop 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 msgr2=0x7ff6b0149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c4a0 tx=0x7ff6a000c960 comp rx=0 tx=0).stop 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 shutdown_connections 2024-01-24T12:44:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff694065a60 0x7ff694067f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff6b01429f0 0x7ff6b0146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b00b42d0 0x7ff6b0149160 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 --2- 172.21.15.27:0/3551466275 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff6b0071160 0x7ff6b0148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 >> 172.21.15.27:0/3551466275 conn(0x7ff6b00be150 msgr2=0x7ff6b00bd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 shutdown_connections 2024-01-24T12:44:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.390+0000 7ff6b779b640 1 -- 172.21.15.27:0/3551466275 wait complete. 2024-01-24T12:44:57.408 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-24T12:44:57.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 Processor -- start 2024-01-24T12:44:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 -- start start 2024-01-24T12:44:57.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f73fc14b540 0x7f73fc0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f73fc06a4c0 0x7f73fc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73fc0bc590 con 0x7f73fc14dfd0 2024-01-24T12:44:57.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc06ae40 con 0x7f73fc06a4c0 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7402ee3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc0bc320 con 0x7f73fc14b540 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7401480640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f73fc14dfd0 0x7f73fc14e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60170/0 (socket says 172.21.15.27:60170) 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7401480640 1 -- 172.21.15.27:0/829070573 learned_addr learned my addr 172.21.15.27:0/829070573 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fbfff640 1 --2- 172.21.15.27:0/829070573 >> v2:172.21.15.27:3300/0 conn(0x7f73fc06a4c0 0x7f73fc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f7400c7f640 1 --2- 172.21.15.27:0/829070573 >> v2:172.21.15.124:3300/0 conn(0x7f73fc14b540 0x7f73fc0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fb7fe640 1 -- 172.21.15.27:0/829070573 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312852079 0 0) 0x7f73fc0bc590 con 0x7f73fc14dfd0 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fb7fe640 1 -- 172.21.15.27:0/829070573 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e4003530 con 0x7f73fc14dfd0 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fbfff640 1 -- 172.21.15.27:0/829070573 >> v2:172.21.15.124:3300/0 conn(0x7f73fc14b540 msgr2=0x7f73fc0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fbfff640 1 --2- 172.21.15.27:0/829070573 >> v2:172.21.15.124:3300/0 conn(0x7f73fc14b540 0x7f73fc0bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fbfff640 1 -- 172.21.15.27:0/829070573 >> v1:172.21.15.27:6789/0 conn(0x7f73fc14dfd0 legacy=0x7f73fc14e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.518+0000 7f73fbfff640 1 -- 172.21.15.27:0/829070573 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc0b3a10 con 0x7f73fc06a4c0 2024-01-24T12:44:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- 172.21.15.27:0/829070573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc06a4c0 0x7f73fc06a900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0be590 tx=0x7f73ec01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa458e80d009ae7d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fb7fe640 1 -- 172.21.15.27:0/829070573 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0a8950 con 0x7f73fc06a4c0 2024-01-24T12:44:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fb7fe640 1 -- 172.21.15.27:0/829070573 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec0a8ab0 con 0x7f73fc06a4c0 2024-01-24T12:44:57.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fb7fe640 1 -- 172.21.15.27:0/829070573 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0a8e40 con 0x7f73fc06a4c0 2024-01-24T12:44:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- 172.21.15.27:0/829070573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc06a4c0 msgr2=0x7f73fc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- 172.21.15.27:0/829070573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc06a4c0 0x7f73fc06a900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0be590 tx=0x7f73ec01ec50 comp rx=0 tx=0).stop 2024-01-24T12:44:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- 172.21.15.27:0/829070573 shutdown_connections 2024-01-24T12:44:57.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- 172.21.15.27:0/829070573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc06a4c0 0x7f73fc06a900 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- 172.21.15.27:0/829070573 >> v2:172.21.15.124:3300/0 conn(0x7f73fc14b540 0x7f73fc0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- 172.21.15.27:0/829070573 >> 172.21.15.27:0/829070573 conn(0x7f73fc0c02e0 msgr2=0x7f73fc0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- 172.21.15.27:0/829070573 shutdown_connections 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- 172.21.15.27:0/829070573 wait complete. 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 Processor -- start 2024-01-24T12:44:57.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- start start 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73fc06a4c0 0x7f73fc1d4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73fc14dfd0 0x7f73fc145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0a5440 con 0x7f73fc14b540 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc1d4980 con 0x7f73fc06a4c0 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7402ee3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0a4910 con 0x7f73fc14dfd0 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50570/0 (socket says 172.21.15.27:50570) 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 -- 172.21.15.27:0/1885560650 learned_addr learned my addr 172.21.15.27:0/1885560650 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f7400c7f640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73fc06a4c0 0x7f73fc1d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 -- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73fc14dfd0 msgr2=0x7f73fc145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73fc14dfd0 0x7f73fc145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 -- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73fc06a4c0 msgr2=0x7f73fc1d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73fc06a4c0 0x7f73fc1d4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 -- 172.21.15.27:0/1885560650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009420 con 0x7f73fc14b540 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.522+0000 7f73fbfff640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009710 tx=0x7f73ec01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0bf070 con 0x7f73fc14b540 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec0b1b30 con 0x7f73fc14b540 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73fc0a5650 con 0x7f73fc14b540 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0b9410 con 0x7f73fc14b540 2024-01-24T12:44:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc0b8a10 con 0x7f73fc14b540 2024-01-24T12:44:57.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc0a5b70 con 0x7f73fc14b540 2024-01-24T12:44:57.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73ec0b7040 con 0x7f73fc14b540 2024-01-24T12:44:57.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 0x7f73e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:44:57.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73ec120bf0 con 0x7f73fc14b540 2024-01-24T12:44:57.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f7400c7f640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 0x7f73e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:44:57.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.526+0000 7f7400c7f640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 0x7f73e8067f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009a30 tx=0x7f73f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:44:57.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.530+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f73ec0ee600 con 0x7f73fc14b540 2024-01-24T12:44:57.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.718+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73fc0a5b70 con 0x7f73fc14b540 2024-01-24T12:44:57.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.718+0000 7f73f97fa640 1 -- 172.21.15.27:0/1885560650 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f73fc0a5b70 con 0x7f73fc14b540 2024-01-24T12:44:57.721 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.718+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 msgr2=0x7f73e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 0x7f73e8067f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009a30 tx=0x7f73f0008040 comp rx=0 tx=0).stop 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 msgr2=0x7f73fc1e2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009710 tx=0x7f73ec01b9f0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 shutdown_connections 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f73e8065a90 0x7f73e8067f50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f73fc14dfd0 0x7f73fc145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f73fc14b540 0x7f73fc1e2d60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 --2- 172.21.15.27:0/1885560650 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f73fc06a4c0 0x7f73fc1d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:44:57.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 >> 172.21.15.27:0/1885560650 conn(0x7f73fc0c02e0 msgr2=0x7f73fc149830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:44:57.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 shutdown_connections 2024-01-24T12:44:57.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:44:57.722+0000 7f7402ee3640 1 -- 172.21.15.27:0/1885560650 wait complete. 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-24T12:44:57.738 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-24T12:44:57.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-24T12:44:57.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T12:44:57.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.739 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-01-24T12:44:57.749 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42480sec preferred_lft 42480sec 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.750 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:03:49:d7:b4 brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-24T12:44:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-01-24T12:44:57.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.753 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-24T12:44:57.813 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-01-24T12:44:57.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.816 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-01-24T12:44:57.872 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-24T12:44:57.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-24T12:44:57.874 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-01-24T12:44:57.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.967 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-24T12:44:57.976 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T12:44:57.977 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-24T12:44:57.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:57.977 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-01-24T12:44:58.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T12:44:58.038 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:58.089 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-24T12:44:58.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-24T12:44:58.089 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:58.140 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-24T12:44:58.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:58.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:58.232 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:58.232 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:58.232 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.124:3300,172.21.15.124:3301" 2024-01-24T12:44:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.124:3300,172.21.15.124:3301" 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.27:6789,172.21.15.124:6789,172.21.15.124:6790" 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.27:6789,172.21.15.124:6789,172.21.15.124:6790:/ 2024-01-24T12:44:58.263 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98" will pass to kernel 2024-01-24T12:44:58.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-24T12:44:58.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:58.268 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-24T12:44:58.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:58.289 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-24T12:44:58.361 INFO:teuthology.orchestra.run.smithi195.stdout:client5169 2024-01-24T12:44:58.361 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:44:58.361 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T12:44:58.414 DEBUG:teuthology.orchestra.run.smithi195:> mktemp -d --suffix=xfstests-dev 2024-01-24T12:44:58.465 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.JNJD3eTBcCxfstests-dev 2024-01-24T12:44:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:58.466 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.JNJD3eTBcCxfstests-dev) 2024-01-24T12:44:58.526 INFO:teuthology.orchestra.run.smithi195.stderr:Cloning into '/tmp/tmp.JNJD3eTBcCxfstests-dev'... 2024-01-24T12:44:59.381 DEBUG:teuthology.orchestra.run.smithi195:> mktemp -d --suffix=xfsprogs-dev 2024-01-24T12:44:59.429 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.8fLKA1aPwyxfsprogs-dev 2024-01-24T12:44:59.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:44:59.429 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.8fLKA1aPwyxfsprogs-dev) 2024-01-24T12:44:59.491 INFO:teuthology.orchestra.run.smithi195.stderr:Cloning into '/tmp/tmp.8fLKA1aPwyxfsprogs-dev'... 2024-01-24T12:45:00.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:45:00.064 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-01-24T12:45:00.128 DEBUG:teuthology.orchestra.run.smithi195:> mktemp -d --suffix=test 2024-01-24T12:45:00.177 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.jay5U8PAbAtest 2024-01-24T12:45:00.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T12:45:00.177 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-01-24T12:45:00.229 DEBUG:teuthology.orchestra.run.smithi195:> mktemp -d --suffix=scratch 2024-01-24T12:45:00.280 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.1rpWfC7Ur8scratch 2024-01-24T12:45:00.281 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-01-24T12:45:00.281 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2024-01-24T12:45:00.395 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-01-24T12:45:00.568 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-01-24T12:45:00.569 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-01-24T12:45:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-01-24T12:45:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-01-24T12:45:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-01-24T12:45:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:gcc set to manually installed. 2024-01-24T12:45:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:gettext is already the newest version (0.21-4ubuntu4). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:make is already the newest version (4.3-4.1build1). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:make set to manually installed. 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:quota is already the newest version (4.06-1build2). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:dbench is already the newest version (4.0-2build1). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:python2 is already the newest version (2.7.18-3). 2024-01-24T12:45:00.722 INFO:teuthology.orchestra.run.smithi195.stdout:python2 set to manually installed. 2024-01-24T12:45:00.723 INFO:teuthology.orchestra.run.smithi195.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-01-24T12:45:00.723 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-01-24T12:45:00.723 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-01-24T12:45:00.723 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout: icu-devtools libbsd-dev libinireader0 libmd-dev libnss-systemd 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout: libpam-systemd libpcre2-32-0 libpcre2-dev libpcre2-posix3 libpmemblk1 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux1-dev libsepol-dev libsqlite3-0 libsystemd0 libudev-dev libudev1 2024-01-24T12:45:00.724 INFO:teuthology.orchestra.run.smithi195.stdout: systemd systemd-sysv udev 2024-01-24T12:45:00.725 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-01-24T12:45:00.725 INFO:teuthology.orchestra.run.smithi195.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2024-01-24T12:45:00.725 INFO:teuthology.orchestra.run.smithi195.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 2024-01-24T12:45:00.771 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-01-24T12:45:00.771 INFO:teuthology.orchestra.run.smithi195.stdout: fio icu-devtools libblkid-dev libbsd-dev libdevmapper-dev libedit-dev 2024-01-24T12:45:00.771 INFO:teuthology.orchestra.run.smithi195.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2024-01-24T12:45:00.771 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libselinux1-dev libsepol-dev 2024-01-24T12:45:00.771 INFO:teuthology.orchestra.run.smithi195.stdout: libudev-dev liburcu-dev pkg-config sqlite3 2024-01-24T12:45:00.772 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-01-24T12:45:00.773 INFO:teuthology.orchestra.run.smithi195.stdout: gawk libnss-systemd libpam-systemd libsqlite3-0 libsystemd0 libudev1 systemd 2024-01-24T12:45:00.774 INFO:teuthology.orchestra.run.smithi195.stdout: systemd-sysv udev 2024-01-24T12:45:00.956 INFO:teuthology.orchestra.run.smithi195.stdout:9 upgraded, 21 newly installed, 0 to remove and 259 not upgraded. 2024-01-24T12:45:00.957 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 27.0 MB of archives. 2024-01-24T12:45:00.957 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 67.5 MB of additional disk space will be used. 2024-01-24T12:45:00.957 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.12 [319 kB] 2024-01-24T12:45:01.456 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.12 [10.5 kB] 2024-01-24T12:45:01.458 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.12 [133 kB] 2024-01-24T12:45:01.483 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.12 [203 kB] 2024-01-24T12:45:01.541 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.12 [4,581 kB] 2024-01-24T12:45:01.816 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.12 [1,557 kB] 2024-01-24T12:45:01.847 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.12 [78.2 kB] 2024-01-24T12:45:01.865 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-01-24T12:45:01.871 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-01-24T12:45:01.880 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-01-24T12:45:01.881 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-01-24T12:45:02.656 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2024-01-24T12:45:03.101 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2024-01-24T12:45:03.113 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2024-01-24T12:45:03.166 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.12 [20.7 kB] 2024-01-24T12:45:03.190 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2024-01-24T12:45:03.281 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2024-01-24T12:45:03.307 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2024-01-24T12:45:03.308 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2024-01-24T12:45:03.383 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2024-01-24T12:45:03.394 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2024-01-24T12:45:03.395 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2024-01-24T12:45:03.839 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-01-24T12:45:04.211 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2024-01-24T12:45:04.876 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2024-01-24T12:45:04.876 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2024-01-24T12:45:04.877 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-24T12:45:04.877 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-01-24T12:45:04.910 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2024-01-24T12:45:04.912 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2024-01-24T12:45:05.169 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: unable to initialize frontend: Dialog 2024-01-24T12:45:05.169 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-01-24T12:45:05.169 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: falling back to frontend: Readline 2024-01-24T12:45:05.183 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: unable to initialize frontend: Readline 2024-01-24T12:45:05.184 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: (This frontend requires a controlling tty.) 2024-01-24T12:45:05.184 INFO:teuthology.orchestra.run.smithi195.stderr:debconf: falling back to frontend: Teletype 2024-01-24T12:45:05.190 INFO:teuthology.orchestra.run.smithi195.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-01-24T12:45:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 27.0 MB in 4s (6,536 kB/s) 2024-01-24T12:45:05.466 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-01-24T12:45:05.470 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:05.678 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:05.983 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:06.381 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-01-24T12:45:06.384 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:06.511 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:06.981 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:07.108 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:07.502 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:07.630 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:08.099 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:08.271 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking systemd (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:09.372 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:09.525 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking udev (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:10.166 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:10.302 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-01-24T12:45:10.641 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:10.896 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:10.899 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:10.902 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:11.125 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-01-24T12:45:11.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-01-24T12:45:11.269 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-01-24T12:45:11.795 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-01-24T12:45:11.931 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-01-24T12:45:12.343 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-01-24T12:45:12.359 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-01-24T12:45:12.402 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-01-24T12:45:12.688 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package fio. 2024-01-24T12:45:12.702 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-fio_3.28-1_amd64.deb ... 2024-01-24T12:45:12.763 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking fio (3.28-1) ... 2024-01-24T12:45:13.159 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package icu-devtools. 2024-01-24T12:45:13.173 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-icu-devtools_70.1-2_amd64.deb ... 2024-01-24T12:45:13.217 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking icu-devtools (70.1-2) ... 2024-01-24T12:45:13.522 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmd-dev:amd64. 2024-01-24T12:45:13.536 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-libmd-dev_1.0.4-1build1_amd64.deb ... 2024-01-24T12:45:13.572 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2024-01-24T12:45:13.961 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbsd-dev:amd64. 2024-01-24T12:45:13.975 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libbsd-dev_0.11.5-1_amd64.deb ... 2024-01-24T12:45:14.019 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2024-01-24T12:45:14.301 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libudev-dev:amd64. 2024-01-24T12:45:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libudev-dev_249.11-0ubuntu3.12_amd64.deb ... 2024-01-24T12:45:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:14.631 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsepol-dev:amd64. 2024-01-24T12:45:14.645 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libsepol-dev_3.3-1build1_amd64.deb ... 2024-01-24T12:45:14.689 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2024-01-24T12:45:15.076 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2024-01-24T12:45:15.090 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:45:15.159 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:15.454 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2024-01-24T12:45:15.468 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:45:15.512 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:15.781 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2024-01-24T12:45:15.795 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2024-01-24T12:45:15.839 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:16.170 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2024-01-24T12:45:16.185 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libselinux1-dev_3.3-1build2_amd64.deb ... 2024-01-24T12:45:16.228 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2024-01-24T12:45:16.543 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2024-01-24T12:45:16.558 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2024-01-24T12:45:16.601 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2024-01-24T12:45:16.862 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libedit-dev:amd64. 2024-01-24T12:45:16.877 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2024-01-24T12:45:16.954 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2024-01-24T12:45:17.217 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-01-24T12:45:17.232 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libgdbm-dev_1.23-1_amd64.deb ... 2024-01-24T12:45:17.267 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-01-24T12:45:17.603 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libicu-dev:amd64. 2024-01-24T12:45:17.618 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libicu-dev_70.1-2_amd64.deb ... 2024-01-24T12:45:17.662 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2024-01-24T12:45:18.432 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libinireader0:amd64. 2024-01-24T12:45:18.448 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libinireader0_53-1ubuntu3_amd64.deb ... 2024-01-24T12:45:18.490 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2024-01-24T12:45:18.768 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libinih-dev:amd64. 2024-01-24T12:45:18.783 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libinih-dev_53-1ubuntu3_amd64.deb ... 2024-01-24T12:45:18.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2024-01-24T12:45:19.138 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pkg-config. 2024-01-24T12:45:19.153 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-24T12:45:19.196 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-24T12:45:19.465 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package sqlite3. 2024-01-24T12:45:19.481 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-01-24T12:45:19.515 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-01-24T12:45:19.768 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libblkid-dev:amd64. 2024-01-24T12:45:19.784 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2024-01-24T12:45:19.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2024-01-24T12:45:20.137 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liburcu-dev:amd64. 2024-01-24T12:45:20.153 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-liburcu-dev_0.13.1-1_amd64.deb ... 2024-01-24T12:45:20.196 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2024-01-24T12:45:20.579 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2024-01-24T12:45:20.702 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2024-01-24T12:45:20.828 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2024-01-24T12:45:20.954 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-01-24T12:45:21.215 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-01-24T12:45:21.341 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up systemd (249.11-0ubuntu3.12) ... 2024-01-24T12:45:22.839 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:22.965 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up udev (249.11-0ubuntu3.12) ... 2024-01-24T12:45:24.444 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up icu-devtools (70.1-2) ... 2024-01-24T12:45:24.569 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-24T12:45:24.846 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:24.972 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2024-01-24T12:45:25.099 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-01-24T12:45:25.216 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2024-01-24T12:45:25.352 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:25.478 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2024-01-24T12:45:25.604 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-01-24T12:45:25.730 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2024-01-24T12:45:25.856 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2024-01-24T12:45:26.007 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-01-24T12:45:26.125 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up systemd-sysv (249.11-0ubuntu3.12) ... 2024-01-24T12:45:26.226 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2024-01-24T12:45:26.351 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2024-01-24T12:45:26.511 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:26.637 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up fio (3.28-1) ... 2024-01-24T12:45:27.188 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2024-01-24T12:45:27.289 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2024-01-24T12:45:27.407 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.12) ... 2024-01-24T12:45:27.621 INFO:teuthology.orchestra.run.smithi195.stdout:debconf: unable to initialize frontend: Dialog 2024-01-24T12:45:27.622 INFO:teuthology.orchestra.run.smithi195.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-01-24T12:45:27.622 INFO:teuthology.orchestra.run.smithi195.stdout:debconf: falling back to frontend: Readline 2024-01-24T12:45:28.252 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-01-24T12:45:28.357 INFO:teuthology.orchestra.run.smithi195.stdout:update-initramfs: Generating /boot/initrd.img-6.7.0-gf2d346040895 2024-01-24T12:45:41.118 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:41.121 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:41.123 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:45:42.650 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-24T12:45:42.793 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-24T12:45:44.262 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-24T12:45:44.348 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-24T12:45:44.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo useradd -m fsgqa 2024-01-24T12:45:44.934 INFO:teuthology.orchestra.run.smithi195.stderr:useradd: user 'fsgqa' already exists 2024-01-24T12:45:44.936 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-01-24T12:45:44.937 DEBUG:teuthology.orchestra.run.smithi195:> sudo groupadd fsgqa 2024-01-24T12:45:44.998 INFO:teuthology.orchestra.run.smithi195.stderr:groupadd: group 'fsgqa' already exists 2024-01-24T12:45:45.000 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-01-24T12:45:45.001 DEBUG:teuthology.orchestra.run.smithi195:> sudo useradd fsgqa2 2024-01-24T12:45:45.436 DEBUG:teuthology.orchestra.run.smithi195:> sudo useradd 123456-fsgqa 2024-01-24T12:45:45.773 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-01-24T12:45:45.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 Processor -- start 2024-01-24T12:45:45.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 -- start start 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4ef80b8ad0 0x7f4ef814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef806cdc0 con 0x7f4ef814b370 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef8071610 con 0x7f4ef8144ea0 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.904+0000 7f4efd28f640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef806ee40 con 0x7f4ef80b8ad0 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4ef814b370 0x7f4ef81554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45036/0 (socket says 172.21.15.27:45036) 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef77fe640 1 -- 172.21.15.27:0/484648343 learned_addr learned my addr 172.21.15.27:0/484648343 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 --2- 172.21.15.27:0/484648343 >> v2:172.21.15.124:3300/0 conn(0x7f4ef80b8ad0 0x7f4ef814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532972162 0 0) 0x7f4ef806cdc0 con 0x7f4ef814b370 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee4003530 con 0x7f4ef814b370 2024-01-24T12:45:45.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844067481 0 0) 0x7f4ee4003530 con 0x7f4ef814b370 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 >> v2:172.21.15.124:3300/0 conn(0x7f4ef80b8ad0 msgr2=0x7f4ef814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 --2- 172.21.15.27:0/484648343 >> v2:172.21.15.124:3300/0 conn(0x7f4ef80b8ad0 0x7f4ef814ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 >> v1:172.21.15.124:6789/0 conn(0x7f4ef8144ea0 legacy=0x7f4ef8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef806c490 con 0x7f4ef814b370 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f4ef0001a00 con 0x7f4ef814b370 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 >> v1:172.21.15.27:6789/0 conn(0x7f4ef814b370 legacy=0x7f4ef81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee4003980 0x7f4ee4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 0x7f4ee4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4005190 0x7f4ee400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef806ee40 con 0x7f4ee4005190 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee400c040 con 0x7f4ee40047d0 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee400c200 con 0x7f4ee4003980 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef77fe640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4005190 0x7f4ee400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 0x7f4ee4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef6ffd640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee4003980 0x7f4ee4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 -- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee4003980 msgr2=0x7f4ee4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee4003980 0x7f4ee4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 -- 172.21.15.27:0/484648343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4005190 msgr2=0x7f4ee400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4005190 0x7f4ee400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4eeffff640 1 -- 172.21.15.27:0/484648343 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4003530 con 0x7f4ee40047d0 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef77fe640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ee4005190 0x7f4ee400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T12:45:45.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.908+0000 7f4ef77fe640 1 -- 172.21.15.27:0/484648343 reap_dead start 2024-01-24T12:45:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4eeffff640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 0x7f4ee4004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009ae0 tx=0x7f4ee001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872f421ec2810e86 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5640 con 0x7f4ee40047d0 2024-01-24T12:45:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee00a57a0 con 0x7f4ee40047d0 2024-01-24T12:45:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef67fc640 1 -- 172.21.15.27:0/484648343 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5b50 con 0x7f4ee40047d0 2024-01-24T12:45:45.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 msgr2=0x7f4ee4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 0x7f4ee4004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009ae0 tx=0x7f4ee001ca50 comp rx=0 tx=0).stop 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- 172.21.15.27:0/484648343 shutdown_connections 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 --2- 172.21.15.27:0/484648343 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ee40047d0 0x7f4ee4004c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- 172.21.15.27:0/484648343 >> 172.21.15.27:0/484648343 conn(0x7f4ef80be150 msgr2=0x7f4ef80be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- 172.21.15.27:0/484648343 shutdown_connections 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- 172.21.15.27:0/484648343 wait complete. 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 Processor -- start 2024-01-24T12:45:45.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- start start 2024-01-24T12:45:45.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee40047d0 0x7f4ef8142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ef8144460 0x7f4ef813a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef81495c0 con 0x7f4ef813aa00 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef8142e70 con 0x7f4ef8144460 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4efd28f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814a5a0 con 0x7f4ee40047d0 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34560/0 (socket says 172.21.15.27:34560) 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 -- 172.21.15.27:0/3309132264 learned_addr learned my addr 172.21.15.27:0/3309132264 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4eeffff640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ef8144460 0x7f4ef813a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef6ffd640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee40047d0 0x7f4ef8142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 -- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee40047d0 msgr2=0x7f4ef8142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee40047d0 0x7f4ef8142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 -- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ef8144460 msgr2=0x7f4ef813a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ef8144460 0x7f4ef813a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 -- 172.21.15.27:0/3309132264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80b3070 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4ef77fe640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ef806d600 tx=0x7f4ef0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.912+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0007aa0 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00133f0 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef8143dd0 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0013760 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef81497b0 con 0x7f4ef813aa00 2024-01-24T12:45:45.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8071a20 con 0x7f4ef813aa00 2024-01-24T12:45:45.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ef00138c0 con 0x7f4ef813aa00 2024-01-24T12:45:45.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4eef7fe640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 0x7f4ed8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:45.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ef0083810 con 0x7f4ef813aa00 2024-01-24T12:45:45.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4ef6ffd640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 0x7f4ed8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:45.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.916+0000 7f4ef6ffd640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 0x7f4ed8067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8007fd0 tx=0x7f4ee8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:45.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:45.920+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4ef00511d0 con 0x7f4ef813aa00 2024-01-24T12:45:46.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.132+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ef80b3200 con 0x7f4ef813aa00 2024-01-24T12:45:46.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.132+0000 7f4eef7fe640 1 -- 172.21.15.27:0/3309132264 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f4ef00547f0 con 0x7f4ef813aa00 2024-01-24T12:45:46.139 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:45:46.139 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":1,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","modified":"2024-01-24T12:43:12.362989Z","created":"2024-01-24T12:43:12.362989Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3301","nonce":0},{"type":"v1","addr":"172.21.15.124:6790","nonce":0}]},"addr":"172.21.15.124:6790/0","public_addr":"172.21.15.124:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-01-24T12:45:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:dumped monmap epoch 1 2024-01-24T12:45:46.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 msgr2=0x7f4ed8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 0x7f4ed8067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8007fd0 tx=0x7f4ee8009040 comp rx=0 tx=0).stop 2024-01-24T12:45:46.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 msgr2=0x7f4ef80b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ef806d600 tx=0x7f4ef0007430 comp rx=0 tx=0).stop 2024-01-24T12:45:46.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 shutdown_connections 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4ed8065a90 0x7f4ed8067f50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef813aa00 0x7f4ef80b3500 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4ef8144460 0x7f4ef813a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 --2- 172.21.15.27:0/3309132264 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4ee40047d0 0x7f4ef8142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 >> 172.21.15.27:0/3309132264 conn(0x7f4ef80be150 msgr2=0x7f4ef80bb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 shutdown_connections 2024-01-24T12:45:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.136+0000 7f4efd28f640 1 -- 172.21.15.27:0/3309132264 wait complete. 2024-01-24T12:45:46.157 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-01-24T12:45:46.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 Processor -- start 2024-01-24T12:45:46.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 -- start start 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4388071160 0x7f43880b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880b3c40 con 0x7f43881429f0 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880b4720 con 0x7f43880b42d0 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438c9cc640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43880b5140 con 0x7f4388071160 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4388071160 0x7f43880b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f4386d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f43881429f0 0x7f4388153260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45048/0 (socket says 172.21.15.27:45048) 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f4386d9d640 1 -- 172.21.15.27:0/3347433396 learned_addr learned my addr 172.21.15.27:0/3347433396 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.268+0000 7f438659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4388071160 0x7f43880b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34568/0 (socket says 172.21.15.27:34568) 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438659c640 1 -- 172.21.15.27:0/3347433396 >> v1:172.21.15.124:6789/0 conn(0x7f43880b42d0 legacy=0x7f43880b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438659c640 1 -- 172.21.15.27:0/3347433396 >> v1:172.21.15.27:6789/0 conn(0x7f43881429f0 legacy=0x7f4388153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438659c640 1 -- 172.21.15.27:0/3347433396 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880b9f60 con 0x7f4388071160 2024-01-24T12:45:46.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438559a640 1 -- 172.21.15.27:0/3347433396 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431624457 0 0) 0x7f43880b3c40 con 0x7f43881429f0 2024-01-24T12:45:46.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438659c640 1 --2- 172.21.15.27:0/3347433396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4388071160 0x7f43880b9900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43780097c0 tx=0x7f437801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca11235eae10f493 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:46.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438559a640 1 -- 172.21.15.27:0/3347433396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780ac620 con 0x7f4388071160 2024-01-24T12:45:46.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438559a640 1 -- 172.21.15.27:0/3347433396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780ac780 con 0x7f4388071160 2024-01-24T12:45:46.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438559a640 1 -- 172.21.15.27:0/3347433396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780acb10 con 0x7f4388071160 2024-01-24T12:45:46.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 -- 172.21.15.27:0/3347433396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4388071160 msgr2=0x7f43880b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 --2- 172.21.15.27:0/3347433396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4388071160 0x7f43880b9900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43780097c0 tx=0x7f437801c3c0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 -- 172.21.15.27:0/3347433396 shutdown_connections 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 --2- 172.21.15.27:0/3347433396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4388071160 0x7f43880b9900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 -- 172.21.15.27:0/3347433396 >> 172.21.15.27:0/3347433396 conn(0x7f43880be150 msgr2=0x7f43880be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 -- 172.21.15.27:0/3347433396 shutdown_connections 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.272+0000 7f438c9cc640 1 -- 172.21.15.27:0/3347433396 wait complete. 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 Processor -- start 2024-01-24T12:45:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- start start 2024-01-24T12:45:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 0x7f4388134660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43880b42d0 0x7f4388140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388134ba0 con 0x7f43881429f0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880a20a0 con 0x7f43880b42d0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43881e17a0 con 0x7f4388071160 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34582/0 (socket says 172.21.15.27:34582) 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 -- 172.21.15.27:0/2035205161 learned_addr learned my addr 172.21.15.27:0/2035205161 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438659c640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 0x7f4388134660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4385d9b640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43880b42d0 0x7f4388140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 -- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 msgr2=0x7f4388134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 0x7f4388134660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 -- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43880b42d0 msgr2=0x7f4388140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43880b42d0 0x7f4388140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 -- 172.21.15.27:0/2035205161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378009420 con 0x7f43881429f0 2024-01-24T12:45:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438659c640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 0x7f4388134660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4386d9d640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f438000c780 tx=0x7f438000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000ce90 con 0x7f43881429f0 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000a640 con 0x7f43881429f0 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43881e1a80 con 0x7f43881429f0 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000a9d0 con 0x7f43881429f0 2024-01-24T12:45:46.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43881e2040 con 0x7f43881429f0 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438804e000 con 0x7f43881429f0 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.276+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f438000ab30 con 0x7f43881429f0 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.280+0000 7f4376ffd640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 0x7f4368067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.280+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4380082550 con 0x7f43881429f0 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.280+0000 7f438659c640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 0x7f4368067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:45:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.280+0000 7f438659c640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 0x7f4368067f50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43780ae000 tx=0x7f4378008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:45:46.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.284+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f438004ffa0 con 0x7f43881429f0 2024-01-24T12:45:46.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.496+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f43880b3070 con 0x7f43881429f0 2024-01-24T12:45:46.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.496+0000 7f4376ffd640 1 -- 172.21.15.27:0/2035205161 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f43800535c0 con 0x7f43881429f0 2024-01-24T12:45:46.501 INFO:teuthology.orchestra.run.smithi027.stdout:[client.admin] 2024-01-24T12:45:46.501 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg== 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 msgr2=0x7f4368067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 0x7f4368067f50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43780ae000 tx=0x7f4378008040 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 msgr2=0x7f43881e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f438000c780 tx=0x7f438000cc40 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 shutdown_connections 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4368065a90 0x7f4368067f50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f43881429f0 0x7f43881e4c00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43880b42d0 0x7f4388140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 --2- 172.21.15.27:0/2035205161 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4388071160 0x7f4388134660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:45:46.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 >> 172.21.15.27:0/2035205161 conn(0x7f43880be150 msgr2=0x7f43880a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:45:46.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 shutdown_connections 2024-01-24T12:45:46.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:45:46.500+0000 7f438c9cc640 1 -- 172.21.15.27:0/2035205161 wait complete. 2024-01-24T12:45:46.521 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:45:46.521 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/tmp/tmp.JNJD3eTBcCxfstests-dev/local.config 2024-01-24T12:45:46.543 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.27:6789:/test export TEST_DIR=/tmp/tmp.jay5U8PAbAtest export SCRATCH_DEV=172.21.15.27:6789:/scratch export SCRATCH_MNT=/tmp/tmp.1rpWfC7Ur8scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg==" 2024-01-24T12:45:46.543 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:45:46.543 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/tmp/tmp.JNJD3eTBcCxfstests-dev/ceph.exclude 2024-01-24T12:45:46.610 DEBUG:teuthology.orchestra.run.smithi195:> (cd /tmp/tmp.JNJD3eTBcCxfstests-dev && exec sudo make) 2024-01-24T12:45:46.678 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize -cfi 2024-01-24T12:45:47.008 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: putting auxiliary files in '.'. 2024-01-24T12:45:47.008 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './config.guess' 2024-01-24T12:45:47.017 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './config.sub' 2024-01-24T12:45:47.038 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './install-sh' 2024-01-24T12:45:47.049 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './ltmain.sh' 2024-01-24T12:45:47.090 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-01-24T12:45:47.090 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-01-24T12:45:47.104 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-01-24T12:45:47.114 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-01-24T12:45:47.124 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-01-24T12:45:47.134 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-01-24T12:45:47.144 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-01-24T12:45:47.146 INFO:teuthology.orchestra.run.smithi195.stdout:cp include/install-sh . 2024-01-24T12:45:47.148 INFO:teuthology.orchestra.run.smithi195.stdout:aclocal -I m4 2024-01-24T12:45:48.211 INFO:teuthology.orchestra.run.smithi195.stdout:autoheader 2024-01-24T12:45:48.563 INFO:teuthology.orchestra.run.smithi195.stdout:autoconf 2024-01-24T12:45:48.962 INFO:teuthology.orchestra.run.smithi195.stdout:./configure \ 2024-01-24T12:45:48.962 INFO:teuthology.orchestra.run.smithi195.stdout: --libexecdir=/usr/lib \ 2024-01-24T12:45:48.962 INFO:teuthology.orchestra.run.smithi195.stdout: --exec_prefix=/var/lib 2024-01-24T12:45:49.564 INFO:teuthology.orchestra.run.smithi195.stdout:checking build system type... x86_64-pc-linux-gnu 2024-01-24T12:45:49.564 INFO:teuthology.orchestra.run.smithi195.stdout:checking host system type... x86_64-pc-linux-gnu 2024-01-24T12:45:49.606 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to print strings... printf 2024-01-24T12:45:49.606 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... gcc 2024-01-24T12:45:49.825 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the C compiler works... yes 2024-01-24T12:45:49.826 INFO:teuthology.orchestra.run.smithi195.stdout:checking for C compiler default output file name... a.out 2024-01-24T12:45:49.867 INFO:teuthology.orchestra.run.smithi195.stdout:checking for suffix of executables... 2024-01-24T12:45:49.966 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether we are cross compiling... no 2024-01-24T12:45:49.992 INFO:teuthology.orchestra.run.smithi195.stdout:checking for suffix of object files... o 2024-01-24T12:45:50.015 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... yes 2024-01-24T12:45:50.039 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... yes 2024-01-24T12:45:50.159 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... none needed 2024-01-24T12:45:50.166 INFO:teuthology.orchestra.run.smithi195.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-01-24T12:45:50.171 INFO:teuthology.orchestra.run.smithi195.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-01-24T12:45:50.173 INFO:teuthology.orchestra.run.smithi195.stdout:checking for egrep... /usr/bin/grep -E 2024-01-24T12:45:50.176 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fgrep... /usr/bin/grep -F 2024-01-24T12:45:50.183 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ld used by gcc... /usr/bin/ld 2024-01-24T12:45:50.187 INFO:teuthology.orchestra.run.smithi195.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-01-24T12:45:50.200 INFO:teuthology.orchestra.run.smithi195.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-01-24T12:45:50.231 INFO:teuthology.orchestra.run.smithi195.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-01-24T12:45:50.231 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether ln -s works... yes 2024-01-24T12:45:50.245 INFO:teuthology.orchestra.run.smithi195.stdout:checking the maximum length of command line arguments... 1572864 2024-01-24T12:45:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-01-24T12:45:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-01-24T12:45:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-01-24T12:45:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:checking for objdump... objdump 2024-01-24T12:45:50.251 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to recognize dependent libraries... pass_all 2024-01-24T12:45:50.252 INFO:teuthology.orchestra.run.smithi195.stdout:checking for dlltool... no 2024-01-24T12:45:50.252 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-01-24T12:45:50.252 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ar... ar 2024-01-24T12:45:50.301 INFO:teuthology.orchestra.run.smithi195.stdout:checking for archiver @FILE support... @ 2024-01-24T12:45:50.301 INFO:teuthology.orchestra.run.smithi195.stdout:checking for strip... strip 2024-01-24T12:45:50.302 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ranlib... ranlib 2024-01-24T12:45:50.302 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gawk... gawk 2024-01-24T12:45:50.389 INFO:teuthology.orchestra.run.smithi195.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-01-24T12:45:50.391 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sysroot... no 2024-01-24T12:45:50.398 INFO:teuthology.orchestra.run.smithi195.stdout:checking for a working dd... /usr/bin/dd 2024-01-24T12:45:50.405 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-01-24T12:45:50.424 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mt... mt 2024-01-24T12:45:50.441 INFO:teuthology.orchestra.run.smithi195.stdout:checking if mt is a manifest tool... no 2024-01-24T12:45:50.473 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdio.h... yes 2024-01-24T12:45:50.516 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdlib.h... yes 2024-01-24T12:45:50.549 INFO:teuthology.orchestra.run.smithi195.stdout:checking for string.h... yes 2024-01-24T12:45:50.597 INFO:teuthology.orchestra.run.smithi195.stdout:checking for inttypes.h... yes 2024-01-24T12:45:50.628 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdint.h... yes 2024-01-24T12:45:50.660 INFO:teuthology.orchestra.run.smithi195.stdout:checking for strings.h... yes 2024-01-24T12:45:50.694 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/stat.h... yes 2024-01-24T12:45:50.726 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/types.h... yes 2024-01-24T12:45:50.803 INFO:teuthology.orchestra.run.smithi195.stdout:checking for unistd.h... yes 2024-01-24T12:45:50.841 INFO:teuthology.orchestra.run.smithi195.stdout:checking for dlfcn.h... yes 2024-01-24T12:45:50.846 INFO:teuthology.orchestra.run.smithi195.stdout:checking for objdir... .libs 2024-01-24T12:45:50.956 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-01-24T12:45:50.956 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-01-24T12:45:50.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-01-24T12:45:51.231 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc static flag -static works... yes 2024-01-24T12:45:51.271 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -c -o file.o... yes 2024-01-24T12:45:51.271 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-01-24T12:45:51.285 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-01-24T12:45:51.320 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether -lc should be explicitly linked in... no 2024-01-24T12:45:51.424 INFO:teuthology.orchestra.run.smithi195.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-01-24T12:45:51.424 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to hardcode library paths into programs... immediate 2024-01-24T12:45:51.433 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether stripping libraries is possible... yes 2024-01-24T12:45:51.433 INFO:teuthology.orchestra.run.smithi195.stdout:checking if libtool supports shared libraries... yes 2024-01-24T12:45:51.433 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether to build shared libraries... yes 2024-01-24T12:45:51.433 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether to build static libraries... yes 2024-01-24T12:45:51.448 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... (cached) gcc 2024-01-24T12:45:51.489 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-01-24T12:45:51.489 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... (cached) yes 2024-01-24T12:45:51.489 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-01-24T12:45:51.490 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gmake... /usr/bin/gmake 2024-01-24T12:45:51.490 INFO:teuthology.orchestra.run.smithi195.stderr:./configure: line 12754: test: $(SHELL): binary operator expected 2024-01-24T12:45:51.491 INFO:teuthology.orchestra.run.smithi195.stdout:checking for tar... /bin/tar 2024-01-24T12:45:51.491 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gzip... /bin/gzip 2024-01-24T12:45:51.505 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc -MM is supported... yes 2024-01-24T12:45:51.506 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sort... /bin/sort 2024-01-24T12:45:51.506 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether ln -s works... yes 2024-01-24T12:45:51.506 INFO:teuthology.orchestra.run.smithi195.stdout:checking for rpm... no 2024-01-24T12:45:51.544 INFO:teuthology.orchestra.run.smithi195.stdout:checking for assert.h... yes 2024-01-24T12:45:51.584 INFO:teuthology.orchestra.run.smithi195.stdout:checking for bstring.h... no 2024-01-24T12:45:51.621 INFO:teuthology.orchestra.run.smithi195.stdout:checking for libgen.h... yes 2024-01-24T12:45:51.689 INFO:teuthology.orchestra.run.smithi195.stdout:checking for dirent.h... yes 2024-01-24T12:45:51.774 INFO:teuthology.orchestra.run.smithi195.stdout:checking for errno.h... yes 2024-01-24T12:45:51.811 INFO:teuthology.orchestra.run.smithi195.stdout:checking for malloc.h... yes 2024-01-24T12:45:51.852 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid.h... no 2024-01-24T12:45:51.907 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid/uuid.h... yes 2024-01-24T12:45:51.947 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/uuid.h... no 2024-01-24T12:45:51.986 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/file.h... yes 2024-01-24T12:45:52.024 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/fcntl.h... yes 2024-01-24T12:45:52.064 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/syssgi.h... no 2024-01-24T12:45:52.126 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/param.h... yes 2024-01-24T12:45:52.127 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/stat.h... (cached) yes 2024-01-24T12:45:52.164 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/statvfs.h... yes 2024-01-24T12:45:52.202 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/time.h... yes 2024-01-24T12:45:52.254 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/ioctl.h... yes 2024-01-24T12:45:52.295 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/wait.h... yes 2024-01-24T12:45:52.295 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/types.h... (cached) yes 2024-01-24T12:45:52.295 INFO:teuthology.orchestra.run.smithi195.stdout:checking for strings.h... (cached) yes 2024-01-24T12:45:52.332 INFO:teuthology.orchestra.run.smithi195.stdout:checking for err.h... yes 2024-01-24T12:45:52.370 INFO:teuthology.orchestra.run.smithi195.stdout:checking for linux/falloc.h... yes 2024-01-24T12:45:52.411 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/fs/xfs_fsops.h... no 2024-01-24T12:45:52.451 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/fs/xfs_itable.h... no 2024-01-24T12:45:52.492 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/platform_defs.h... no 2024-01-24T12:45:52.532 INFO:teuthology.orchestra.run.smithi195.stdout:checking for btrfs/ioctl.h... no 2024-01-24T12:45:52.572 INFO:teuthology.orchestra.run.smithi195.stdout:checking for cifs/ioctl.h... no 2024-01-24T12:45:52.612 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/mman.h... yes 2024-01-24T12:45:52.635 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/xfs_log_format.h... no 2024-01-24T12:45:52.692 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid_compare... no 2024-01-24T12:45:52.739 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid_compare in -luuid... yes 2024-01-24T12:45:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/xfs.h... yes 2024-01-24T12:45:52.881 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/libxfs.h... no 2024-01-24T12:45:52.928 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-01-24T12:45:52.959 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether xlog_assign_lsn is declared... no 2024-01-24T12:45:53.005 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/xqm.h... yes 2024-01-24T12:45:53.077 INFO:teuthology.orchestra.run.smithi195.stdout:checking xfsctl from xfs/xfs.h... ok 2024-01-24T12:45:53.117 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xfs/handle.h... yes 2024-01-24T12:45:53.177 INFO:teuthology.orchestra.run.smithi195.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-01-24T12:45:53.219 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/acl.h... yes 2024-01-24T12:45:53.256 INFO:teuthology.orchestra.run.smithi195.stdout:checking for acl/libacl.h... yes 2024-01-24T12:45:53.305 INFO:teuthology.orchestra.run.smithi195.stdout:checking for acl_init in -lacl... yes 2024-01-24T12:45:53.345 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gdbm-ndbm.h... no 2024-01-24T12:45:53.385 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gdbm/ndbm.h... no 2024-01-24T12:45:53.425 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ndbm.h... no 2024-01-24T12:45:53.464 INFO:teuthology.orchestra.run.smithi195.stdout:checking for libaio.h... yes 2024-01-24T12:45:53.505 INFO:teuthology.orchestra.run.smithi195.stdout:checking for liburing.h... no 2024-01-24T12:45:53.546 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/capability.h... no 2024-01-24T12:45:53.584 INFO:teuthology.orchestra.run.smithi195.stdout:checking for linux/fiemap.h... yes 2024-01-24T12:45:53.633 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fallocate... yes 2024-01-24T12:45:53.687 INFO:teuthology.orchestra.run.smithi195.stdout:checking for open_by_handle_at... yes 2024-01-24T12:45:53.727 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/prctl.h... yes 2024-01-24T12:45:53.765 INFO:teuthology.orchestra.run.smithi195.stdout:checking for linux/fs.h... yes 2024-01-24T12:45:53.805 INFO:teuthology.orchestra.run.smithi195.stdout:checking for btrfsutil.h... no 2024-01-24T12:45:53.861 INFO:teuthology.orchestra.run.smithi195.stdout:checking for copy_file_range... yes 2024-01-24T12:45:53.917 INFO:teuthology.orchestra.run.smithi195.stdout:checking for SEEK_DATA... yes 2024-01-24T12:45:53.992 INFO:teuthology.orchestra.run.smithi195.stdout:checking for BMV_OF_SHARED... yes 2024-01-24T12:45:54.046 INFO:teuthology.orchestra.run.smithi195.stdout:checking for nftw... yes 2024-01-24T12:45:54.099 INFO:teuthology.orchestra.run.smithi195.stdout:checking for RLIMIT_NOFILE... yes 2024-01-24T12:45:54.152 INFO:teuthology.orchestra.run.smithi195.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-01-24T12:45:54.203 INFO:teuthology.orchestra.run.smithi195.stdout:checking for FICLONE... yes 2024-01-24T12:45:54.254 INFO:teuthology.orchestra.run.smithi195.stdout:checking for renameat2... yes 2024-01-24T12:45:54.304 INFO:teuthology.orchestra.run.smithi195.stdout:checking for reallocarray... yes 2024-01-24T12:45:54.354 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct mount_attr... yes 2024-01-24T12:45:54.406 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_qgroup_limit... yes 2024-01-24T12:45:54.457 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-01-24T12:45:54.509 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-01-24T12:45:54.561 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-01-24T12:45:54.612 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-01-24T12:45:54.664 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-01-24T12:45:54.716 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-01-24T12:45:54.755 INFO:teuthology.orchestra.run.smithi195.stdout:checking for linux/btrfs.h... yes 2024-01-24T12:45:54.795 INFO:teuthology.orchestra.run.smithi195.stdout:checking for linux/btrfs_tree.h... yes 2024-01-24T12:45:54.822 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-01-24T12:45:54.848 INFO:teuthology.orchestra.run.smithi195.stdout:configure: creating ./config.status 2024-01-24T12:45:55.643 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: creating include/builddefs 2024-01-24T12:45:55.669 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: creating include/config.h 2024-01-24T12:45:55.690 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: executing libtool commands 2024-01-24T12:45:55.757 INFO:teuthology.orchestra.run.smithi195.stdout:Building include 2024-01-24T12:45:55.763 INFO:teuthology.orchestra.run.smithi195.stdout:Building lib 2024-01-24T12:45:55.768 INFO:teuthology.orchestra.run.smithi195.stdout: [LTDEP] 2024-01-24T12:45:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dataascii.lo 2024-01-24T12:45:56.108 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] databin.lo 2024-01-24T12:45:56.291 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] datapid.lo 2024-01-24T12:45:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] file_lock.lo 2024-01-24T12:45:56.614 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] forker.lo 2024-01-24T12:45:56.788 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] pattern.lo 2024-01-24T12:45:56.929 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] open_flags.lo 2024-01-24T12:45:57.101 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] random_range.lo 2024-01-24T12:45:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] string_to_tokens.lo 2024-01-24T12:45:57.481 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] str_to_bytes.lo 2024-01-24T12:45:57.647 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] tlibio.lo 2024-01-24T12:45:57.927 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] write_log.lo 2024-01-24T12:45:58.011 INFO:teuthology.orchestra.run.smithi195.stderr:write_log.c: In function 'wlog_record_write': 2024-01-24T12:45:58.011 INFO:teuthology.orchestra.run.smithi195.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:45:58.011 INFO:teuthology.orchestra.run.smithi195.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-01-24T12:45:58.011 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:45:58.012 INFO:teuthology.orchestra.run.smithi195.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:45:58.012 INFO:teuthology.orchestra.run.smithi195.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-01-24T12:45:58.012 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:45:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] random.lo 2024-01-24T12:45:58.320 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] 2024-01-24T12:45:58.440 INFO:teuthology.orchestra.run.smithi195.stdout:Building ltp 2024-01-24T12:45:58.445 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:45:58.646 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] doio 2024-01-24T12:45:59.357 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsstress 2024-01-24T12:46:00.799 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsx 2024-01-24T12:46:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] growfiles 2024-01-24T12:46:02.125 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] iogen 2024-01-24T12:46:02.283 INFO:teuthology.orchestra.run.smithi195.stderr:iogen.c: In function 'main': 2024-01-24T12:46:02.283 INFO:teuthology.orchestra.run.smithi195.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:02.283 INFO:teuthology.orchestra.run.smithi195.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-01-24T12:46:02.283 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:02.285 INFO:teuthology.orchestra.run.smithi195.stderr:iogen.c: In function 'parse_cmdline': 2024-01-24T12:46:02.286 INFO:teuthology.orchestra.run.smithi195.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:02.286 INFO:teuthology.orchestra.run.smithi195.stderr: 1535 | getcwd(fptr->f_path, 2024-01-24T12:46:02.286 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:02.286 INFO:teuthology.orchestra.run.smithi195.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-01-24T12:46:02.286 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:02.556 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-stress 2024-01-24T12:46:02.711 INFO:teuthology.orchestra.run.smithi195.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-01-24T12:46:02.711 INFO:teuthology.orchestra.run.smithi195.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:02.711 INFO:teuthology.orchestra.run.smithi195.stderr: 1013 | ftruncate(fd, total_ram); 2024-01-24T12:46:02.711 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:03.023 INFO:teuthology.orchestra.run.smithi195.stdout:Building src 2024-01-24T12:46:03.031 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:46:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:46:05.485 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:46:05.499 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:46:05.818 INFO:teuthology.orchestra.run.smithi195.stdout: [DEP] 2024-01-24T12:46:05.852 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dirstress 2024-01-24T12:46:06.139 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fill 2024-01-24T12:46:06.324 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fill2 2024-01-24T12:46:06.590 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] getpagesize 2024-01-24T12:46:06.758 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] holes 2024-01-24T12:46:06.990 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] lstat64 2024-01-24T12:46:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] nametest 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr:nametest.c: In function 'main': 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: 236 | write(1, "\n", 1); 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: 238 | write(1, ".", 1); 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: 288 | write(1, ".", 1); 2024-01-24T12:46:07.367 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:07.488 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] permname 2024-01-24T12:46:07.724 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] randholes 2024-01-24T12:46:08.010 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] runas 2024-01-24T12:46:08.222 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] truncfile 2024-01-24T12:46:08.438 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] usemem 2024-01-24T12:46:08.623 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mmapcat 2024-01-24T12:46:08.764 INFO:teuthology.orchestra.run.smithi195.stderr:mmapcat.c: In function 'main': 2024-01-24T12:46:08.764 INFO:teuthology.orchestra.run.smithi195.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:08.764 INFO:teuthology.orchestra.run.smithi195.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-01-24T12:46:08.764 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:08.806 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] append_reader 2024-01-24T12:46:08.995 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] append_writer 2024-01-24T12:46:09.182 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dirperf 2024-01-24T12:46:09.442 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] metaperf 2024-01-24T12:46:09.591 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c: In function 'crfiles': 2024-01-24T12:46:09.591 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: 166 | write(fd, buf, fsize); 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c: In function 't_linkun': 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: 454 | link("a", *fnp); 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~ 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c: In function 't_chown': 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: 404 | chown(*fnp, 2, -1); 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: 406 | chown(*fnp, 1, -1); 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:09.592 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c: In function 'i_chown': 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: 291 | chown(*fnp, 1, -1); 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c: In function 'main': 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: 152 | chdir(".."); 2024-01-24T12:46:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~ 2024-01-24T12:46:09.778 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] devzero 2024-01-24T12:46:09.992 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] feature 2024-01-24T12:46:10.247 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] alloc 2024-01-24T12:46:10.405 INFO:teuthology.orchestra.run.smithi195.stderr:alloc.c: In function 'main': 2024-01-24T12:46:10.405 INFO:teuthology.orchestra.run.smithi195.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:10.406 INFO:teuthology.orchestra.run.smithi195.stderr: 247 | mkstemp(tmpfile); 2024-01-24T12:46:10.406 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:10.500 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fault 2024-01-24T12:46:10.699 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fstest 2024-01-24T12:46:10.980 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_access_root 2024-01-24T12:46:11.121 INFO:teuthology.orchestra.run.smithi195.stderr:t_access_root.c: In function 'main': 2024-01-24T12:46:11.121 INFO:teuthology.orchestra.run.smithi195.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:11.122 INFO:teuthology.orchestra.run.smithi195.stderr: 55 | system(cmd); 2024-01-24T12:46:11.122 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~ 2024-01-24T12:46:11.171 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] godown 2024-01-24T12:46:11.191 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:11.194 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:11.196 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] resvtest 2024-01-24T12:46:11.607 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] writemod 2024-01-24T12:46:11.787 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] writev_on_pagefault 2024-01-24T12:46:11.982 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] makeextents 2024-01-24T12:46:12.199 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] itrash 2024-01-24T12:46:12.385 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] rename 2024-01-24T12:46:12.555 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] multi_open_unlink 2024-01-24T12:46:12.758 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] unwritten_sync 2024-01-24T12:46:12.977 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] genhashnames 2024-01-24T12:46:13.199 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_holes 2024-01-24T12:46:13.381 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_writev 2024-01-24T12:46:13.564 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_truncate_cmtime 2024-01-24T12:46:13.758 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dirhash_collide 2024-01-24T12:46:13.975 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_rename_overwrite 2024-01-24T12:46:14.149 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] holetest 2024-01-24T12:46:14.299 INFO:teuthology.orchestra.run.smithi195.stderr:holetest.c: In function 'pt_write_marker': 2024-01-24T12:46:14.299 INFO:teuthology.orchestra.run.smithi195.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:14.299 INFO:teuthology.orchestra.run.smithi195.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-01-24T12:46:14.299 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:14.413 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_truncate_self 2024-01-24T12:46:14.587 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] af_unix 2024-01-24T12:46:14.783 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_stale_pmd 2024-01-24T12:46:14.926 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-01-24T12:46:14.926 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:14.926 INFO:teuthology.orchestra.run.smithi195.stderr: 42 | ftruncate(fd, 0); 2024-01-24T12:46:14.926 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr: 43 | ftruncate(fd, MiB(4)); 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-01-24T12:46:14.927 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:14.971 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_cow_race 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_cow_race.c: In function 'main': 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr: 61 | ftruncate(fd, 0); 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr: 62 | ftruncate(fd, MiB(2)); 2024-01-24T12:46:15.119 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:15.174 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_fallocate 2024-01-24T12:46:15.360 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsync-err 2024-01-24T12:46:15.581 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_write_ro 2024-01-24T12:46:15.771 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_ext4_dax_journal_corruption 2024-01-24T12:46:15.916 INFO:teuthology.orchestra.run.smithi195.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-01-24T12:46:15.916 INFO:teuthology.orchestra.run.smithi195.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:15.917 INFO:teuthology.orchestra.run.smithi195.stderr: 61 | ftruncate(fd, 0); 2024-01-24T12:46:15.917 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:15.968 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_ext4_dax_inline_corruption 2024-01-24T12:46:16.160 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_ofd_locks 2024-01-24T12:46:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_collision 2024-01-24T12:46:16.633 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mmap-write-concurrent 2024-01-24T12:46:16.839 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_get_file_time 2024-01-24T12:46:17.021 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_create_short_dirs 2024-01-24T12:46:17.225 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_create_long_dirs 2024-01-24T12:46:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_enospc 2024-01-24T12:46:17.672 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_writev_overlap 2024-01-24T12:46:17.880 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] checkpoint_journal 2024-01-24T12:46:18.271 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mmap-rw-fault 2024-01-24T12:46:18.499 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] allocstale 2024-01-24T12:46:18.708 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_cow_memory_failure 2024-01-24T12:46:18.913 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fake-dump-rootino 2024-01-24T12:46:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dio-buf-fault 2024-01-24T12:46:19.288 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] rewinddir-test 2024-01-24T12:46:19.496 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] readdir-while-renames 2024-01-24T12:46:19.696 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfsctl 2024-01-24T12:46:19.924 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bstat 2024-01-24T12:46:20.171 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mtab 2024-01-24T12:46:20.318 INFO:teuthology.orchestra.run.smithi195.stderr:t_mtab.c: In function 'update_mtab': 2024-01-24T12:46:20.318 INFO:teuthology.orchestra.run.smithi195.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:20.318 INFO:teuthology.orchestra.run.smithi195.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-01-24T12:46:20.318 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:20.397 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] getdevicesize 2024-01-24T12:46:20.574 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] preallo_rw_pattern_reader 2024-01-24T12:46:20.727 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-01-24T12:46:20.727 INFO:teuthology.orchestra.run.smithi195.stderr:iopat.c: In function 'main': 2024-01-24T12:46:20.727 INFO:teuthology.orchestra.run.smithi195.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:20.728 INFO:teuthology.orchestra.run.smithi195.stderr: 38 | read(fd, &x, 1048576); 2024-01-24T12:46:20.728 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:20.770 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] preallo_rw_pattern_writer 2024-01-24T12:46:20.923 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-01-24T12:46:20.923 INFO:teuthology.orchestra.run.smithi195.stderr:iopat.c: In function 'main': 2024-01-24T12:46:20.923 INFO:teuthology.orchestra.run.smithi195.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:20.923 INFO:teuthology.orchestra.run.smithi195.stderr: 34 | write(fd, &x, 1048576); 2024-01-24T12:46:20.923 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] ftrunc 2024-01-24T12:46:21.150 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] trunc 2024-01-24T12:46:21.354 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fs_perms 2024-01-24T12:46:21.500 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c: In function 'main': 2024-01-24T12:46:21.500 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:21.500 INFO:teuthology.orchestra.run.smithi195.stderr: 54 | system("rm -f test.file"); 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c: In function 'testsetup': 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr: 67 | system("cp testx.file test.file"); 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c: In function 'testfperm': 2024-01-24T12:46:21.501 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:21.502 INFO:teuthology.orchestra.run.smithi195.stderr: 123 | seteuid(0); 2024-01-24T12:46:21.502 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~ 2024-01-24T12:46:21.502 INFO:teuthology.orchestra.run.smithi195.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:21.502 INFO:teuthology.orchestra.run.smithi195.stderr: 124 | setegid(0); 2024-01-24T12:46:21.502 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~ 2024-01-24T12:46:21.553 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] testx 2024-01-24T12:46:21.716 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] looptest 2024-01-24T12:46:21.949 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] locktest 2024-01-24T12:46:22.296 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] unwritten_mmap 2024-01-24T12:46:22.495 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkstat_unlink_test 2024-01-24T12:46:22.648 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test.c: In function 'main': 2024-01-24T12:46:22.648 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:22.649 INFO:teuthology.orchestra.run.smithi195.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-01-24T12:46:22.649 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:22.649 INFO:teuthology.orchestra.run.smithi195.stderr: 178 | system(fname); 2024-01-24T12:46:22.649 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~ 2024-01-24T12:46:22.735 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] deduperace 2024-01-24T12:46:22.969 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkstat_unlink_test_modified 2024-01-24T12:46:23.124 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-01-24T12:46:23.124 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.124 INFO:teuthology.orchestra.run.smithi195.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-01-24T12:46:23.124 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.124 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.125 INFO:teuthology.orchestra.run.smithi195.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-01-24T12:46:23.125 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.125 INFO:teuthology.orchestra.run.smithi195.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.125 INFO:teuthology.orchestra.run.smithi195.stderr: 185 | system(fname); 2024-01-24T12:46:23.125 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~ 2024-01-24T12:46:23.207 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_dir_offset 2024-01-24T12:46:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_futimens 2024-01-24T12:46:23.564 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_immutable 2024-01-24T12:46:23.732 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c: In function 'create_test_area': 2024-01-24T12:46:23.732 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.732 INFO:teuthology.orchestra.run.smithi195.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-01-24T12:46:23.732 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.732 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.733 INFO:teuthology.orchestra.run.smithi195.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-01-24T12:46:23.733 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.733 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c: In function 'remove_test_area': 2024-01-24T12:46:23.733 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-01-24T12:46:23.734 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.736 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c: In function 'check_test_area': 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-01-24T12:46:23.737 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-01-24T12:46:23.738 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.740 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c: In function 'test_immutable': 2024-01-24T12:46:23.740 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.740 INFO:teuthology.orchestra.run.smithi195.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-01-24T12:46:23.740 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: 408 | chown(path, 0, 0); 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.741 INFO:teuthology.orchestra.run.smithi195.stderr: 553 | chown(path, 0, 0); 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: 653 | chown(path, 0, 0); 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: 705 | chown(path, 0, 0); 2024-01-24T12:46:23.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.744 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.744 INFO:teuthology.orchestra.run.smithi195.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-01-24T12:46:23.744 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c: In function 'test_append': 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-01-24T12:46:23.746 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: 1051 | chown(path, 0, 0); 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: 1516 | chown(path, 0, 0); 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.747 INFO:teuthology.orchestra.run.smithi195.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.748 INFO:teuthology.orchestra.run.smithi195.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: 1618 | chown(path, 0, 0); 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: 1644 | chown(path, 0, 0); 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: 1692 | chown(path, 0, 0); 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~ 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-01-24T12:46:23.750 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:24.283 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] stale_handle 2024-01-24T12:46:24.437 INFO:teuthology.orchestra.run.smithi195.stderr:stale_handle.c: In function 'main': 2024-01-24T12:46:24.437 INFO:teuthology.orchestra.run.smithi195.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:24.437 INFO:teuthology.orchestra.run.smithi195.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-01-24T12:46:24.437 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:24.493 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] pwrite_mmap_blocked 2024-01-24T12:46:24.681 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_dir_offset2 2024-01-24T12:46:24.912 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] seek_sanity_test 2024-01-24T12:46:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c: In function 'test18': 2024-01-24T12:46:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.073 INFO:teuthology.orchestra.run.smithi195.stderr: 460 | ftruncate(fd, 0); 2024-01-24T12:46:25.073 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-01-24T12:46:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.075 INFO:teuthology.orchestra.run.smithi195.stderr: 1207 | ftruncate(fd, 0); 2024-01-24T12:46:25.075 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: 1256 | ftruncate(fd, 0); 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: 88 | ftruncate(fd, 0); 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: 98 | ftruncate(fd, 0); 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.076 INFO:teuthology.orchestra.run.smithi195.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-01-24T12:46:25.077 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] seek_copy_test 2024-01-24T12:46:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_readdir_1 2024-01-24T12:46:25.742 INFO:teuthology.orchestra.run.smithi195.stderr:t_readdir_1.c: In function 'main': 2024-01-24T12:46:25.743 INFO:teuthology.orchestra.run.smithi195.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:25.743 INFO:teuthology.orchestra.run.smithi195.stderr: 30 | read(fd, buf, 100); 2024-01-24T12:46:25.743 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:25.783 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_readdir_2 2024-01-24T12:46:25.969 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsync-tester 2024-01-24T12:46:26.113 INFO:teuthology.orchestra.run.smithi195.stderr:fsync-tester.c: In function 'main': 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: 541 | system("reboot -fn"); 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-01-24T12:46:26.114 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:26.262 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] nsexec 2024-01-24T12:46:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] cloner 2024-01-24T12:46:26.693 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] renameat2 2024-01-24T12:46:26.897 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_getcwd 2024-01-24T12:46:27.040 INFO:teuthology.orchestra.run.smithi195.stderr:t_getcwd.c: In function 'test_getcwd': 2024-01-24T12:46:27.040 INFO:teuthology.orchestra.run.smithi195.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:27.040 INFO:teuthology.orchestra.run.smithi195.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-01-24T12:46:27.040 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:27.093 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] e4compact 2024-01-24T12:46:27.334 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] test-nextquota 2024-01-24T12:46:27.545 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] punch-alternating 2024-01-24T12:46:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attr-list-by-handle-cursor-test 2024-01-24T12:46:27.960 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] listxattr 2024-01-24T12:46:28.140 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dio-interleaved 2024-01-24T12:46:28.339 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_dir_type 2024-01-24T12:46:28.530 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dio-invalidate-cache 2024-01-24T12:46:28.729 INFO:teuthology.orchestra.run.smithi195.stderr:dio-invalidate-cache.c: In function 'main': 2024-01-24T12:46:28.729 INFO:teuthology.orchestra.run.smithi195.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:28.729 INFO:teuthology.orchestra.run.smithi195.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-01-24T12:46:28.729 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:28.773 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] stat_test 2024-01-24T12:46:29.102 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_encrypted_d_revalidate 2024-01-24T12:46:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attr_replace_test 2024-01-24T12:46:29.505 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] swapon 2024-01-24T12:46:29.707 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mkswap 2024-01-24T12:46:29.895 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_attr_corruption 2024-01-24T12:46:30.080 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_open_tmpfiles 2024-01-24T12:46:30.298 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fscrypt-crypt-util 2024-01-24T12:46:30.968 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkstat_null_ocount 2024-01-24T12:46:31.163 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] splice-test 2024-01-24T12:46:31.383 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] chprojid_fail 2024-01-24T12:46:31.584 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] detached_mounts_propagation 2024-01-24T12:46:31.807 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] ext4_resize 2024-01-24T12:46:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_readdir_3 2024-01-24T12:46:32.227 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] splice2pipe 2024-01-24T12:46:32.369 INFO:teuthology.orchestra.run.smithi195.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-01-24T12:46:32.369 INFO:teuthology.orchestra.run.smithi195.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:32.369 INFO:teuthology.orchestra.run.smithi195.stderr: 57 | write(p[1], buffer, n); 2024-01-24T12:46:32.369 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:32.369 INFO:teuthology.orchestra.run.smithi195.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:32.370 INFO:teuthology.orchestra.run.smithi195.stderr: 65 | read(p[0], buffer, n); 2024-01-24T12:46:32.370 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:32.426 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] uuid_ioctl 2024-01-24T12:46:32.621 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fiemap-tester 2024-01-24T12:46:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_stripealign 2024-01-24T12:46:33.114 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] open_by_handle 2024-01-24T12:46:33.465 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_mmap_dio 2024-01-24T12:46:33.665 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfsfind 2024-01-24T12:46:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] t_reflink_read_race 2024-01-24T12:46:34.132 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fssum 2024-01-24T12:46:34.604 INFO:teuthology.orchestra.run.smithi195.stdout:Building log-writes 2024-01-24T12:46:34.613 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] replay-log 2024-01-24T12:46:34.990 INFO:teuthology.orchestra.run.smithi195.stdout:Building perf 2024-01-24T12:46:34.996 INFO:teuthology.orchestra.run.smithi195.stdout:Building aio-dio-regress 2024-01-24T12:46:35.006 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aiocp 2024-01-24T12:46:35.279 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-append-write-fallocate-race 2024-01-24T12:46:35.494 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-append-write-read-race 2024-01-24T12:46:35.716 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-cow-race 2024-01-24T12:46:35.914 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-cycle-write 2024-01-24T12:46:36.058 INFO:teuthology.orchestra.run.smithi195.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-01-24T12:46:36.058 INFO:teuthology.orchestra.run.smithi195.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:36.058 INFO:teuthology.orchestra.run.smithi195.stderr: 83 | ftruncate(fd, buf_size); 2024-01-24T12:46:36.058 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:36.148 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-eof-race 2024-01-24T12:46:36.376 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-extend-stat 2024-01-24T12:46:36.585 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-fcntl-race 2024-01-24T12:46:36.792 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-hole-filling-race 2024-01-24T12:46:36.988 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-invalidate-failure 2024-01-24T12:46:37.191 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-invalidate-readahead 2024-01-24T12:46:37.403 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aiodio_sparse2 2024-01-24T12:46:37.547 INFO:teuthology.orchestra.run.smithi195.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-01-24T12:46:37.547 INFO:teuthology.orchestra.run.smithi195.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr: 111 | ftruncate(fd, filesize); 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr: 274 | ftruncate(fd, size); 2024-01-24T12:46:37.548 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-01-24T12:46:37.668 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-subblock-eof-read 2024-01-24T12:46:37.857 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-dio-write-verify 2024-01-24T12:46:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-01-24T12:46:38.280 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-01-24T12:46:38.456 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] aio-last-ref-held-by-io 2024-01-24T12:46:38.679 INFO:teuthology.orchestra.run.smithi195.stdout:Building vfs 2024-01-24T12:46:38.687 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] vfstest 2024-01-24T12:46:40.838 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mount-idmapped 2024-01-24T12:46:41.269 INFO:teuthology.orchestra.run.smithi195.stdout:Building m4 2024-01-24T12:46:41.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:41.275 INFO:teuthology.orchestra.run.smithi195.stdout:Building common 2024-01-24T12:46:41.275 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:41.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:46:41.281 INFO:teuthology.orchestra.run.smithi195.stdout:Building tests 2024-01-24T12:46:41.290 INFO:teuthology.orchestra.run.smithi195.stdout:Building btrfs 2024-01-24T12:46:41.300 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/btrfs/group.list 2024-01-24T12:46:41.426 INFO:teuthology.orchestra.run.smithi195.stdout:Building ceph 2024-01-24T12:46:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ceph/group.list 2024-01-24T12:46:41.466 INFO:teuthology.orchestra.run.smithi195.stdout:Building cifs 2024-01-24T12:46:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/cifs/group.list 2024-01-24T12:46:41.501 INFO:teuthology.orchestra.run.smithi195.stdout:Building ext4 2024-01-24T12:46:41.509 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ext4/group.list 2024-01-24T12:46:41.590 INFO:teuthology.orchestra.run.smithi195.stdout:Building f2fs 2024-01-24T12:46:41.598 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/f2fs/group.list 2024-01-24T12:46:41.635 INFO:teuthology.orchestra.run.smithi195.stdout:Building generic 2024-01-24T12:46:41.646 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/generic/group.list 2024-01-24T12:46:41.851 INFO:teuthology.orchestra.run.smithi195.stdout:Building nfs 2024-01-24T12:46:41.859 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/nfs/group.list 2024-01-24T12:46:41.890 INFO:teuthology.orchestra.run.smithi195.stdout:Building ocfs2 2024-01-24T12:46:41.898 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ocfs2/group.list 2024-01-24T12:46:41.927 INFO:teuthology.orchestra.run.smithi195.stdout:Building overlay 2024-01-24T12:46:41.936 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/overlay/group.list 2024-01-24T12:46:42.023 INFO:teuthology.orchestra.run.smithi195.stdout:Building perf 2024-01-24T12:46:42.031 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/perf/group.list 2024-01-24T12:46:42.056 INFO:teuthology.orchestra.run.smithi195.stdout:Building selftest 2024-01-24T12:46:42.064 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/selftest/group.list 2024-01-24T12:46:42.091 INFO:teuthology.orchestra.run.smithi195.stdout:Building shared 2024-01-24T12:46:42.099 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/shared/group.list 2024-01-24T12:46:42.137 INFO:teuthology.orchestra.run.smithi195.stdout:Building tmpfs 2024-01-24T12:46:42.144 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/tmpfs/group.list 2024-01-24T12:46:42.173 INFO:teuthology.orchestra.run.smithi195.stdout:Building udf 2024-01-24T12:46:42.181 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/udf/group.list 2024-01-24T12:46:42.206 INFO:teuthology.orchestra.run.smithi195.stdout:Building xfs 2024-01-24T12:46:42.217 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/xfs/group.list 2024-01-24T12:46:42.427 DEBUG:teuthology.orchestra.run.smithi195:> (cd /tmp/tmp.JNJD3eTBcCxfstests-dev && exec sudo make install) 2024-01-24T12:46:42.467 INFO:teuthology.orchestra.run.smithi195.stdout:Building include 2024-01-24T12:46:42.473 INFO:teuthology.orchestra.run.smithi195.stdout:Building lib 2024-01-24T12:46:42.480 INFO:teuthology.orchestra.run.smithi195.stdout:Building ltp 2024-01-24T12:46:42.487 INFO:teuthology.orchestra.run.smithi195.stdout:Building src 2024-01-24T12:46:42.541 INFO:teuthology.orchestra.run.smithi195.stdout:Building log-writes 2024-01-24T12:46:42.547 INFO:teuthology.orchestra.run.smithi195.stdout:Building perf 2024-01-24T12:46:42.553 INFO:teuthology.orchestra.run.smithi195.stdout:Building aio-dio-regress 2024-01-24T12:46:42.560 INFO:teuthology.orchestra.run.smithi195.stdout:Building vfs 2024-01-24T12:46:42.566 INFO:teuthology.orchestra.run.smithi195.stdout:Building m4 2024-01-24T12:46:42.573 INFO:teuthology.orchestra.run.smithi195.stdout:Building common 2024-01-24T12:46:42.579 INFO:teuthology.orchestra.run.smithi195.stdout:Building tests 2024-01-24T12:46:42.588 INFO:teuthology.orchestra.run.smithi195.stdout:Building btrfs 2024-01-24T12:46:42.597 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/btrfs/group.list 2024-01-24T12:46:42.721 INFO:teuthology.orchestra.run.smithi195.stdout:Building ceph 2024-01-24T12:46:42.729 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ceph/group.list 2024-01-24T12:46:42.760 INFO:teuthology.orchestra.run.smithi195.stdout:Building cifs 2024-01-24T12:46:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/cifs/group.list 2024-01-24T12:46:42.797 INFO:teuthology.orchestra.run.smithi195.stdout:Building ext4 2024-01-24T12:46:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ext4/group.list 2024-01-24T12:46:42.885 INFO:teuthology.orchestra.run.smithi195.stdout:Building f2fs 2024-01-24T12:46:42.893 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/f2fs/group.list 2024-01-24T12:46:42.930 INFO:teuthology.orchestra.run.smithi195.stdout:Building generic 2024-01-24T12:46:42.941 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/generic/group.list 2024-01-24T12:46:43.143 INFO:teuthology.orchestra.run.smithi195.stdout:Building nfs 2024-01-24T12:46:43.151 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/nfs/group.list 2024-01-24T12:46:43.182 INFO:teuthology.orchestra.run.smithi195.stdout:Building ocfs2 2024-01-24T12:46:43.190 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ocfs2/group.list 2024-01-24T12:46:43.219 INFO:teuthology.orchestra.run.smithi195.stdout:Building overlay 2024-01-24T12:46:43.228 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/overlay/group.list 2024-01-24T12:46:43.313 INFO:teuthology.orchestra.run.smithi195.stdout:Building perf 2024-01-24T12:46:43.322 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/perf/group.list 2024-01-24T12:46:43.346 INFO:teuthology.orchestra.run.smithi195.stdout:Building selftest 2024-01-24T12:46:43.355 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/selftest/group.list 2024-01-24T12:46:43.382 INFO:teuthology.orchestra.run.smithi195.stdout:Building shared 2024-01-24T12:46:43.390 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/shared/group.list 2024-01-24T12:46:43.427 INFO:teuthology.orchestra.run.smithi195.stdout:Building tmpfs 2024-01-24T12:46:43.437 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/tmpfs/group.list 2024-01-24T12:46:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:Building udf 2024-01-24T12:46:43.473 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/udf/group.list 2024-01-24T12:46:43.497 INFO:teuthology.orchestra.run.smithi195.stdout:Building xfs 2024-01-24T12:46:43.508 INFO:teuthology.orchestra.run.smithi195.stdout: [GROUP] /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/xfs/group.list 2024-01-24T12:46:43.709 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-01-24T12:46:43.715 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-24T12:46:43.715 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-01-24T12:46:43.717 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-24T12:46:43.717 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-01-24T12:46:43.723 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-01-24T12:46:43.741 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-01-24T12:46:43.893 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-01-24T12:46:43.912 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-01-24T12:46:43.940 INFO:teuthology.orchestra.run.smithi195.stdout:Building log-writes 2024-01-24T12:46:43.947 INFO:teuthology.orchestra.run.smithi195.stdout:Building perf 2024-01-24T12:46:43.953 INFO:teuthology.orchestra.run.smithi195.stdout:Building aio-dio-regress 2024-01-24T12:46:43.960 INFO:teuthology.orchestra.run.smithi195.stdout:Building vfs 2024-01-24T12:46:43.965 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake -C log-writes install 2024-01-24T12:46:43.968 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-01-24T12:46:43.988 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-01-24T12:46:44.007 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake -C perf install 2024-01-24T12:46:44.011 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-01-24T12:46:44.030 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-01-24T12:46:44.077 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-01-24T12:46:44.081 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-01-24T12:46:44.100 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-01-24T12:46:44.208 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake -C vfs install 2024-01-24T12:46:44.211 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-01-24T12:46:44.231 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-01-24T12:46:44.257 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-01-24T12:46:44.276 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-01-24T12:46:46.947 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-01-24T12:46:47.159 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-01-24T12:46:47.204 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-01-24T12:46:47.208 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-24T12:46:47.208 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-01-24T12:46:47.211 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-01-24T12:46:47.231 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-01-24T12:46:47.500 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-01-24T12:46:47.504 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/btrfs/ install 2024-01-24T12:46:47.509 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-01-24T12:46:47.529 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2024-01-24T12:46:49.174 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-01-24T12:46:49.194 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2024-01-24T12:46:50.855 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ceph/ install 2024-01-24T12:46:50.859 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-01-24T12:46:50.879 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-01-24T12:46:50.919 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-01-24T12:46:50.939 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-01-24T12:46:50.980 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/cifs/ install 2024-01-24T12:46:50.983 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-01-24T12:46:51.002 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-01-24T12:46:51.022 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-01-24T12:46:51.041 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-01-24T12:46:51.061 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ext4/ install 2024-01-24T12:46:51.065 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-01-24T12:46:51.084 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-01-24T12:46:51.462 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-01-24T12:46:51.481 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-01-24T12:46:51.881 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/f2fs/ install 2024-01-24T12:46:51.884 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-01-24T12:46:51.904 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-01-24T12:46:51.929 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-01-24T12:46:51.948 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-01-24T12:46:51.973 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/generic/ install 2024-01-24T12:46:51.981 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-01-24T12:46:52.000 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 /var/lib/xfstests/tests/generic 2024-01-24T12:46:56.001 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-01-24T12:46:56.020 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out /var/lib/xfstests/tests/generic 2024-01-24T12:47:00.065 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/nfs/ install 2024-01-24T12:47:00.068 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-01-24T12:47:00.088 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-01-24T12:47:00.108 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-01-24T12:47:00.127 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-01-24T12:47:00.146 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/ocfs2/ install 2024-01-24T12:47:00.150 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-01-24T12:47:00.169 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-01-24T12:47:00.189 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-01-24T12:47:00.208 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-01-24T12:47:00.228 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/overlay/ install 2024-01-24T12:47:00.232 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-01-24T12:47:00.251 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-01-24T12:47:00.826 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-01-24T12:47:00.845 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-01-24T12:47:01.423 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/perf/ install 2024-01-24T12:47:01.427 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-01-24T12:47:01.446 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-01-24T12:47:01.466 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-01-24T12:47:01.485 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-01-24T12:47:01.504 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/selftest/ install 2024-01-24T12:47:01.508 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-01-24T12:47:01.528 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-01-24T12:47:01.574 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-01-24T12:47:01.593 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-01-24T12:47:01.640 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/shared/ install 2024-01-24T12:47:01.643 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-01-24T12:47:01.663 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-01-24T12:47:01.692 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-01-24T12:47:01.712 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-01-24T12:47:01.742 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/tmpfs/ install 2024-01-24T12:47:01.746 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-01-24T12:47:01.765 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-01-24T12:47:01.785 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-01-24T12:47:01.805 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-01-24T12:47:01.825 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/udf/ install 2024-01-24T12:47:01.828 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-01-24T12:47:01.847 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-01-24T12:47:01.867 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-01-24T12:47:01.885 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-01-24T12:47:01.905 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.JNJD3eTBcCxfstests-dev/tests/xfs/ install 2024-01-24T12:47:01.912 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-01-24T12:47:01.931 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-01-24T12:47:05.710 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-01-24T12:47:05.730 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-01-24T12:47:09.550 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-01-24T12:47:09.570 INFO:teuthology.orchestra.run.smithi195.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-01-24T12:47:09.589 INFO:teuthology.orchestra.run.smithi195.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-01-24T12:47:09.609 INFO:teuthology.orchestra.run.smithi195.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-01-24T12:47:09.631 DEBUG:teuthology.orchestra.run.smithi195:> (cd /tmp/tmp.8fLKA1aPwyxfsprogs-dev && exec sudo make) 2024-01-24T12:47:09.702 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize -c -i -f 2024-01-24T12:47:09.906 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2024-01-24T12:47:09.906 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './config.guess' 2024-01-24T12:47:09.915 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './config.sub' 2024-01-24T12:47:09.923 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './install-sh' 2024-01-24T12:47:09.933 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file './ltmain.sh' 2024-01-24T12:47:09.973 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-01-24T12:47:09.973 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-01-24T12:47:09.982 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-01-24T12:47:09.992 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-01-24T12:47:10.002 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-01-24T12:47:10.012 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-01-24T12:47:10.022 INFO:teuthology.orchestra.run.smithi195.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-01-24T12:47:10.024 INFO:teuthology.orchestra.run.smithi195.stdout:cp include/install-sh . 2024-01-24T12:47:10.026 INFO:teuthology.orchestra.run.smithi195.stdout:aclocal -I m4 2024-01-24T12:47:11.039 INFO:teuthology.orchestra.run.smithi195.stdout:autoconf 2024-01-24T12:47:11.321 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:11.324 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:11.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:11.474 INFO:teuthology.orchestra.run.smithi195.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2024-01-24T12:47:11.620 INFO:teuthology.orchestra.run.smithi195.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-01-24T12:47:11.690 INFO:teuthology.orchestra.run.smithi195.stdout:checking build system type... x86_64-pc-linux-gnu 2024-01-24T12:47:11.690 INFO:teuthology.orchestra.run.smithi195.stdout:checking host system type... x86_64-pc-linux-gnu 2024-01-24T12:47:11.720 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to print strings... printf 2024-01-24T12:47:11.721 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... gcc 2024-01-24T12:47:11.806 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the C compiler works... yes 2024-01-24T12:47:11.806 INFO:teuthology.orchestra.run.smithi195.stdout:checking for C compiler default output file name... a.out 2024-01-24T12:47:11.847 INFO:teuthology.orchestra.run.smithi195.stdout:checking for suffix of executables... 2024-01-24T12:47:11.895 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether we are cross compiling... no 2024-01-24T12:47:11.921 INFO:teuthology.orchestra.run.smithi195.stdout:checking for suffix of object files... o 2024-01-24T12:47:11.944 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... yes 2024-01-24T12:47:11.967 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... yes 2024-01-24T12:47:12.018 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... none needed 2024-01-24T12:47:12.024 INFO:teuthology.orchestra.run.smithi195.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-01-24T12:47:12.029 INFO:teuthology.orchestra.run.smithi195.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-01-24T12:47:12.032 INFO:teuthology.orchestra.run.smithi195.stdout:checking for egrep... /usr/bin/grep -E 2024-01-24T12:47:12.035 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fgrep... /usr/bin/grep -F 2024-01-24T12:47:12.042 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ld used by gcc... /usr/bin/ld 2024-01-24T12:47:12.045 INFO:teuthology.orchestra.run.smithi195.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-01-24T12:47:12.049 INFO:teuthology.orchestra.run.smithi195.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-01-24T12:47:12.079 INFO:teuthology.orchestra.run.smithi195.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-01-24T12:47:12.079 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether ln -s works... yes 2024-01-24T12:47:12.085 INFO:teuthology.orchestra.run.smithi195.stdout:checking the maximum length of command line arguments... 1572864 2024-01-24T12:47:12.091 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking for objdump... objdump 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to recognize dependent libraries... pass_all 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking for dlltool... no 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-01-24T12:47:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ar... ar 2024-01-24T12:47:12.127 INFO:teuthology.orchestra.run.smithi195.stdout:checking for archiver @FILE support... @ 2024-01-24T12:47:12.127 INFO:teuthology.orchestra.run.smithi195.stdout:checking for strip... strip 2024-01-24T12:47:12.128 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ranlib... ranlib 2024-01-24T12:47:12.128 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gawk... gawk 2024-01-24T12:47:12.214 INFO:teuthology.orchestra.run.smithi195.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-01-24T12:47:12.217 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sysroot... no 2024-01-24T12:47:12.224 INFO:teuthology.orchestra.run.smithi195.stdout:checking for a working dd... /usr/bin/dd 2024-01-24T12:47:12.230 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-01-24T12:47:12.249 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mt... mt 2024-01-24T12:47:12.256 INFO:teuthology.orchestra.run.smithi195.stdout:checking if mt is a manifest tool... no 2024-01-24T12:47:12.282 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdio.h... yes 2024-01-24T12:47:12.311 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdlib.h... yes 2024-01-24T12:47:12.343 INFO:teuthology.orchestra.run.smithi195.stdout:checking for string.h... yes 2024-01-24T12:47:12.374 INFO:teuthology.orchestra.run.smithi195.stdout:checking for inttypes.h... yes 2024-01-24T12:47:12.406 INFO:teuthology.orchestra.run.smithi195.stdout:checking for stdint.h... yes 2024-01-24T12:47:12.438 INFO:teuthology.orchestra.run.smithi195.stdout:checking for strings.h... yes 2024-01-24T12:47:12.470 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/stat.h... yes 2024-01-24T12:47:12.502 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/types.h... yes 2024-01-24T12:47:12.538 INFO:teuthology.orchestra.run.smithi195.stdout:checking for unistd.h... yes 2024-01-24T12:47:12.575 INFO:teuthology.orchestra.run.smithi195.stdout:checking for dlfcn.h... yes 2024-01-24T12:47:12.581 INFO:teuthology.orchestra.run.smithi195.stdout:checking for objdir... .libs 2024-01-24T12:47:12.679 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-01-24T12:47:12.679 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-01-24T12:47:12.706 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-01-24T12:47:12.808 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc static flag -static works... yes 2024-01-24T12:47:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -c -o file.o... yes 2024-01-24T12:47:12.848 INFO:teuthology.orchestra.run.smithi195.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-01-24T12:47:12.862 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-01-24T12:47:12.897 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether -lc should be explicitly linked in... no 2024-01-24T12:47:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-01-24T12:47:12.980 INFO:teuthology.orchestra.run.smithi195.stdout:checking how to hardcode library paths into programs... immediate 2024-01-24T12:47:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether stripping libraries is possible... yes 2024-01-24T12:47:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking if libtool supports shared libraries... yes 2024-01-24T12:47:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether to build shared libraries... yes 2024-01-24T12:47:12.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether to build static libraries... yes 2024-01-24T12:47:12.984 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... (cached) gcc 2024-01-24T12:47:13.025 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-01-24T12:47:13.025 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... (cached) yes 2024-01-24T12:47:13.025 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-01-24T12:47:13.038 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... (cached) gcc 2024-01-24T12:47:13.079 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-01-24T12:47:13.079 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... (cached) yes 2024-01-24T12:47:13.080 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-01-24T12:47:13.087 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc... (cached) gcc 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc accepts -g... (cached) yes 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gmake... /usr/bin/gmake 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking for tar... /usr/bin/tar 2024-01-24T12:47:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gzip... /usr/bin/gzip 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether gcc -MM is supported... yes 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sort... /bin/sort 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether ln -s works... yes 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking for msgfmt... /usr/bin/msgfmt 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking for msgmerge... /usr/bin/msgmerge 2024-01-24T12:47:13.144 INFO:teuthology.orchestra.run.smithi195.stdout:checking for xgettext... /usr/bin/xgettext 2024-01-24T12:47:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:checking for rpm... no 2024-01-24T12:47:13.197 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ini.h... yes 2024-01-24T12:47:13.245 INFO:teuthology.orchestra.run.smithi195.stdout:checking for ini_parse in -linih... yes 2024-01-24T12:47:13.285 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid.h... no 2024-01-24T12:47:13.326 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sys/uuid.h... no 2024-01-24T12:47:13.363 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid/uuid.h... yes 2024-01-24T12:47:13.420 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid_compare... no 2024-01-24T12:47:13.468 INFO:teuthology.orchestra.run.smithi195.stdout:checking for uuid_compare in -luuid... yes 2024-01-24T12:47:13.507 INFO:teuthology.orchestra.run.smithi195.stdout:checking for pthread.h... yes 2024-01-24T12:47:13.555 INFO:teuthology.orchestra.run.smithi195.stdout:checking for pthread_mutex_init in -lpthread... yes 2024-01-24T12:47:13.599 INFO:teuthology.orchestra.run.smithi195.stdout:checking for urcu.h... yes 2024-01-24T12:47:13.637 INFO:teuthology.orchestra.run.smithi195.stdout:checking for liburcu... yes 2024-01-24T12:47:13.665 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fadvise ... yes 2024-01-24T12:47:13.692 INFO:teuthology.orchestra.run.smithi195.stdout:checking for madvise ... yes 2024-01-24T12:47:13.720 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mincore ... yes 2024-01-24T12:47:13.754 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sendfile ... yes 2024-01-24T12:47:13.785 INFO:teuthology.orchestra.run.smithi195.stdout:checking for getmntent ... yes 2024-01-24T12:47:13.836 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fallocate... yes 2024-01-24T12:47:13.887 INFO:teuthology.orchestra.run.smithi195.stdout:checking for fiemap... yes 2024-01-24T12:47:13.944 INFO:teuthology.orchestra.run.smithi195.stdout:checking for pwritev2... yes 2024-01-24T12:47:14.001 INFO:teuthology.orchestra.run.smithi195.stdout:checking for preadv... yes 2024-01-24T12:47:14.057 INFO:teuthology.orchestra.run.smithi195.stdout:checking for copy_file_range... yes 2024-01-24T12:47:14.108 INFO:teuthology.orchestra.run.smithi195.stdout:checking for sync_file_range... yes 2024-01-24T12:47:14.162 INFO:teuthology.orchestra.run.smithi195.stdout:checking for syncfs... yes 2024-01-24T12:47:14.201 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mntent.h... yes 2024-01-24T12:47:14.247 INFO:teuthology.orchestra.run.smithi195.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-01-24T12:47:14.281 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether fls is declared... no 2024-01-24T12:47:14.336 INFO:teuthology.orchestra.run.smithi195.stdout:checking for readdir... yes 2024-01-24T12:47:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether fsetxattr is declared... yes 2024-01-24T12:47:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether mremap is declared... yes 2024-01-24T12:47:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct fsxattr... yes 2024-01-24T12:47:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2024-01-24T12:47:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct fscrypt_add_key_arg... yes 2024-01-24T12:47:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2024-01-24T12:47:14.629 INFO:teuthology.orchestra.run.smithi195.stdout:checking for GETFSMAP... yes 2024-01-24T12:47:14.682 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct statfs... yes 2024-01-24T12:47:14.708 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct statfs.f_flags... yes 2024-01-24T12:47:14.733 INFO:teuthology.orchestra.run.smithi195.stdout:checking for MAP_SYNC... yes 2024-01-24T12:47:14.844 INFO:teuthology.orchestra.run.smithi195.stdout:checking for library containing dm_task_create... -ldevmapper 2024-01-24T12:47:14.881 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mallinfo ... yes 2024-01-24T12:47:14.912 INFO:teuthology.orchestra.run.smithi195.stdout:checking for mallinfo2 ... yes 2024-01-24T12:47:14.952 INFO:teuthology.orchestra.run.smithi195.stdout:checking for attr/attributes.h... yes 2024-01-24T12:47:14.978 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct attrlist_cursor... yes 2024-01-24T12:47:14.981 INFO:teuthology.orchestra.run.smithi195.stdout:checking for pkg-config... /usr/bin/pkg-config 2024-01-24T12:47:14.983 INFO:teuthology.orchestra.run.smithi195.stdout:checking pkg-config is at least version 0.9.0... yes 2024-01-24T12:47:14.994 INFO:teuthology.orchestra.run.smithi195.stdout:checking for icu-i18n... yes 2024-01-24T12:47:15.032 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether openat is declared... yes 2024-01-24T12:47:15.074 INFO:teuthology.orchestra.run.smithi195.stdout:checking whether fstatat is declared... yes 2024-01-24T12:47:15.119 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct sg_io_hdr ... yes 2024-01-24T12:47:15.148 INFO:teuthology.orchestra.run.smithi195.stdout:checking for struct hd_geometry ... yes 2024-01-24T12:47:15.162 INFO:teuthology.orchestra.run.smithi195.stdout:checking for systemd... yes 2024-01-24T12:47:15.165 INFO:teuthology.orchestra.run.smithi195.stdout:checking for systemd system unit dir... /lib/systemd/system 2024-01-24T12:47:15.165 INFO:teuthology.orchestra.run.smithi195.stdout:checking for system crontab dir... /etc/cron.d 2024-01-24T12:47:15.177 INFO:teuthology.orchestra.run.smithi195.stdout:checking for udev... yes 2024-01-24T12:47:15.180 INFO:teuthology.orchestra.run.smithi195.stdout:checking for udev rule dir... /lib/udev/rules.d 2024-01-24T12:47:15.287 INFO:teuthology.orchestra.run.smithi195.stdout:checking for library containing blkid_probe_all... -lblkid 2024-01-24T12:47:15.339 INFO:teuthology.orchestra.run.smithi195.stdout:checking for blkid_probe_get_topology... yes 2024-01-24T12:47:15.412 INFO:teuthology.orchestra.run.smithi195.stdout:checking size of long... 8 2024-01-24T12:47:15.484 INFO:teuthology.orchestra.run.smithi195.stdout:checking size of char *... 8 2024-01-24T12:47:15.506 INFO:teuthology.orchestra.run.smithi195.stdout:checking for umode_t... no 2024-01-24T12:47:15.570 INFO:teuthology.orchestra.run.smithi195.stdout:checking for atomic64_t support in liburcu... yes 2024-01-24T12:47:15.599 INFO:teuthology.orchestra.run.smithi195.stdout:configure: creating ./config.status 2024-01-24T12:47:16.408 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: creating include/builddefs 2024-01-24T12:47:16.433 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: creating include/platform_defs.h 2024-01-24T12:47:16.453 INFO:teuthology.orchestra.run.smithi195.stdout:config.status: executing libtool commands 2024-01-24T12:47:16.530 INFO:teuthology.orchestra.run.smithi195.stdout: [HEADERS] include 2024-01-24T12:47:16.555 INFO:teuthology.orchestra.run.smithi195.stdout: [HEADERS] libxfs 2024-01-24T12:47:16.588 INFO:teuthology.orchestra.run.smithi195.stdout:Building include 2024-01-24T12:47:16.597 INFO:teuthology.orchestra.run.smithi195.stdout: [LN] disk 2024-01-24T12:47:16.601 INFO:teuthology.orchestra.run.smithi195.stdout:Building libfrog 2024-01-24T12:47:16.607 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] gen_crc32table 2024-01-24T12:47:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: [GENERATE] crc32table.h 2024-01-24T12:47:17.138 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] avl64.lo 2024-01-24T12:47:17.596 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bitmap.lo 2024-01-24T12:47:17.925 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkstat.lo 2024-01-24T12:47:18.307 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] convert.lo 2024-01-24T12:47:18.663 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] crc32.lo 2024-01-24T12:47:18.888 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsgeom.lo 2024-01-24T12:47:19.208 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] list_sort.lo 2024-01-24T12:47:19.427 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] linux.lo 2024-01-24T12:47:19.758 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] logging.lo 2024-01-24T12:47:19.920 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] paths.lo 2024-01-24T12:47:20.353 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] projects.lo 2024-01-24T12:47:20.657 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] ptvar.lo 2024-01-24T12:47:20.915 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] radix-tree.lo 2024-01-24T12:47:21.427 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] randbytes.lo 2024-01-24T12:47:21.647 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] scrub.lo 2024-01-24T12:47:21.856 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] util.lo 2024-01-24T12:47:22.084 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] workqueue.lo 2024-01-24T12:47:22.368 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] libfrog.la 2024-01-24T12:47:22.486 INFO:teuthology.orchestra.run.smithi195.stdout:Building libxfs 2024-01-24T12:47:24.091 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] cache.lo 2024-01-24T12:47:24.614 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] defer_item.lo 2024-01-24T12:47:25.032 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.lo 2024-01-24T12:47:25.713 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] kmem.lo 2024-01-24T12:47:26.011 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] logitem.lo 2024-01-24T12:47:26.331 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] rdwr.lo 2024-01-24T12:47:27.146 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] topology.lo 2024-01-24T12:47:27.515 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] trans.lo 2024-01-24T12:47:28.023 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] util.lo 2024-01-24T12:47:28.518 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_ag.lo 2024-01-24T12:47:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_ag_resv.lo 2024-01-24T12:47:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_alloc.lo 2024-01-24T12:47:31.111 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_alloc_btree.lo 2024-01-24T12:47:31.582 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_attr.lo 2024-01-24T12:47:32.161 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_attr_leaf.lo 2024-01-24T12:47:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_attr_remote.lo 2024-01-24T12:47:34.020 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_bit.lo 2024-01-24T12:47:34.306 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_bmap.lo 2024-01-24T12:47:36.934 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_bmap_btree.lo 2024-01-24T12:47:37.450 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_btree.lo 2024-01-24T12:47:39.543 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_btree_staging.lo 2024-01-24T12:47:40.003 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_da_btree.lo 2024-01-24T12:47:41.233 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_defer.lo 2024-01-24T12:47:41.443 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:41.446 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:41.448 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:47:41.731 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2.lo 2024-01-24T12:47:42.236 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2_block.lo 2024-01-24T12:47:43.054 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2_data.lo 2024-01-24T12:47:43.795 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2_leaf.lo 2024-01-24T12:47:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2_node.lo 2024-01-24T12:47:45.697 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dir2_sf.lo 2024-01-24T12:47:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_dquot_buf.lo 2024-01-24T12:47:46.839 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_ialloc.lo 2024-01-24T12:47:48.096 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_iext_tree.lo 2024-01-24T12:47:48.793 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_inode_buf.lo 2024-01-24T12:47:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_inode_fork.lo 2024-01-24T12:47:50.020 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_ialloc_btree.lo 2024-01-24T12:47:50.532 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_log_rlimit.lo 2024-01-24T12:47:50.844 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_refcount.lo 2024-01-24T12:47:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_refcount_btree.lo 2024-01-24T12:47:52.097 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_rmap.lo 2024-01-24T12:47:53.244 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_rmap_btree.lo 2024-01-24T12:47:53.764 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_rtbitmap.lo 2024-01-24T12:47:54.375 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_sb.lo 2024-01-24T12:47:55.160 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_symlink_remote.lo 2024-01-24T12:47:55.520 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_trans_inode.lo 2024-01-24T12:47:55.813 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_trans_resv.lo 2024-01-24T12:47:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_types.lo 2024-01-24T12:47:56.722 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] libxfs.la 2024-01-24T12:47:56.934 INFO:teuthology.orchestra.run.smithi195.stdout:Building libxlog 2024-01-24T12:47:57.025 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_log_recover.lo 2024-01-24T12:47:57.814 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] util.lo 2024-01-24T12:47:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] libxlog.la 2024-01-24T12:47:58.278 INFO:teuthology.orchestra.run.smithi195.stdout:Building libxcmd 2024-01-24T12:47:58.409 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] command.lo 2024-01-24T12:47:58.750 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] input.lo 2024-01-24T12:47:59.058 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] help.lo 2024-01-24T12:47:59.308 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] quit.lo 2024-01-24T12:47:59.536 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] libxcmd.la 2024-01-24T12:47:59.635 INFO:teuthology.orchestra.run.smithi195.stdout:Building libhandle 2024-01-24T12:47:59.714 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] handle.lo 2024-01-24T12:48:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] jdm.lo 2024-01-24T12:48:00.372 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] libhandle.la 2024-01-24T12:48:00.509 INFO:teuthology.orchestra.run.smithi195.stdout:Building copy 2024-01-24T12:48:00.565 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_copy.o 2024-01-24T12:48:00.988 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_copy 2024-01-24T12:48:01.170 INFO:teuthology.orchestra.run.smithi195.stdout:Building db 2024-01-24T12:48:03.157 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] addr.o 2024-01-24T12:48:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] agf.o 2024-01-24T12:48:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] agfl.o 2024-01-24T12:48:03.479 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] agi.o 2024-01-24T12:48:03.584 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attr.o 2024-01-24T12:48:03.781 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attrshort.o 2024-01-24T12:48:03.903 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bit.o 2024-01-24T12:48:04.032 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] block.o 2024-01-24T12:48:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bmap.o 2024-01-24T12:48:04.377 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] btblock.o 2024-01-24T12:48:04.509 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bmroot.o 2024-01-24T12:48:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] check.o 2024-01-24T12:48:06.400 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] command.o 2024-01-24T12:48:06.512 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] crc.o 2024-01-24T12:48:06.632 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] debug.o 2024-01-24T12:48:06.728 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dir2.o 2024-01-24T12:48:07.012 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dir2sf.o 2024-01-24T12:48:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dquot.o 2024-01-24T12:48:07.275 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] echo.o 2024-01-24T12:48:07.368 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] faddr.o 2024-01-24T12:48:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] field.o 2024-01-24T12:48:07.670 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] flist.o 2024-01-24T12:48:07.901 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fprint.o 2024-01-24T12:48:08.063 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] frag.o 2024-01-24T12:48:08.300 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] freesp.o 2024-01-24T12:48:08.494 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] hash.o 2024-01-24T12:48:08.569 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c: In function 'hash_f': 2024-01-24T12:48:08.569 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.569 INFO:teuthology.orchestra.run.smithi195.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2024-01-24T12:48:08.569 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~^~~ 2024-01-24T12:48:08.569 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr: | char * 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from ../include/libxfs.h:59, 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2024-01-24T12:48:08.570 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2024-01-24T12:48:08.573 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c: In function 'collide_dirents': 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~ 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: | const unsigned char * 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from /usr/include/fcntl.h:314, 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/platform_defs.h:12, 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.574 INFO:teuthology.orchestra.run.smithi195.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~ 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from /usr/include/features.h:486, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/stdio.h:27, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/platform_defs.h:10, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~ 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2024-01-24T12:48:08.575 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~ 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: | const unsigned char * 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from /usr/include/features.h:486, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/stdio.h:27, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/platform_defs.h:10, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~ 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.576 INFO:teuthology.orchestra.run.smithi195.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~ 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | const unsigned char * 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from ../include/platform_defs.h:19, 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~~ 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.577 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from ../include/platform_defs.h:19, 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: 826 | const char *__to, int __flags) 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~^~~~ 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c: In function 'collide_xattrs': 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~ 2024-01-24T12:48:08.578 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from /usr/include/features.h:486, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/stdio.h:27, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/platform_defs.h:10, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~ 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2024-01-24T12:48:08.579 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~ 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from hash.c:16: 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~ 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from /usr/include/features.h:486, 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-01-24T12:48:08.580 INFO:teuthology.orchestra.run.smithi195.stderr: from /usr/include/stdio.h:27, 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/platform_defs.h:10, 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: from ../include/libxfs.h:11, 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: from hash.c:7: 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~ 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~~~~~~~ 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: | unsigned char * 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr:In file included from hash.c:16: 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-01-24T12:48:08.581 INFO:teuthology.orchestra.run.smithi195.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c: In function 'hashcoll_f': 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~ 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | char * 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: 300 | const unsigned char *name, 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | ^~~ 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.582 INFO:teuthology.orchestra.run.smithi195.stderr: | char * 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: 234 | const unsigned char *name, 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~^~~ 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: | char * 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: 300 | const unsigned char *name, 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2024-01-24T12:48:08.583 INFO:teuthology.orchestra.run.smithi195.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~^~~ 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr: | | 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr: | char * 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr: 234 | const unsigned char *name, 2024-01-24T12:48:08.584 INFO:teuthology.orchestra.run.smithi195.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-01-24T12:48:08.667 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] help.o 2024-01-24T12:48:08.769 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.o 2024-01-24T12:48:08.901 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] inode.o 2024-01-24T12:48:09.172 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] input.o 2024-01-24T12:48:09.312 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] io.o 2024-01-24T12:48:09.517 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] logformat.o 2024-01-24T12:48:09.642 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] malloc.o 2024-01-24T12:48:09.740 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] metadump.o 2024-01-24T12:48:10.520 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] output.o 2024-01-24T12:48:10.631 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] print.o 2024-01-24T12:48:10.790 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] quit.o 2024-01-24T12:48:10.881 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sb.o 2024-01-24T12:48:11.125 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sig.o 2024-01-24T12:48:11.222 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] strvec.o 2024-01-24T12:48:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] text.o 2024-01-24T12:48:11.438 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] type.o 2024-01-24T12:48:11.562 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] write.o 2024-01-24T12:48:11.566 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:11.569 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:11.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attrset.o 2024-01-24T12:48:11.926 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] symlink.o 2024-01-24T12:48:12.029 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsmap.o 2024-01-24T12:48:12.156 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fuzz.o 2024-01-24T12:48:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] obfuscate.o 2024-01-24T12:48:12.463 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] btdump.o 2024-01-24T12:48:12.641 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] btheight.o 2024-01-24T12:48:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] convert.o 2024-01-24T12:48:12.959 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] info.o 2024-01-24T12:48:13.083 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] iunlink.o 2024-01-24T12:48:13.261 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] namei.o 2024-01-24T12:48:13.467 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] timelimit.o 2024-01-24T12:48:13.580 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_db 2024-01-24T12:48:13.824 INFO:teuthology.orchestra.run.smithi195.stdout:Building estimate 2024-01-24T12:48:13.878 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_estimate.o 2024-01-24T12:48:14.018 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_estimate 2024-01-24T12:48:14.102 INFO:teuthology.orchestra.run.smithi195.stdout:Building fsck 2024-01-24T12:48:14.108 INFO:teuthology.orchestra.run.smithi195.stdout:Building fsr 2024-01-24T12:48:14.165 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_fsr.o 2024-01-24T12:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_fsr 2024-01-24T12:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Building growfs 2024-01-24T12:48:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_growfs.o 2024-01-24T12:48:14.927 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_growfs 2024-01-24T12:48:15.107 INFO:teuthology.orchestra.run.smithi195.stdout:Building io 2024-01-24T12:48:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.o 2024-01-24T12:48:16.548 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attr.o 2024-01-24T12:48:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bmap.o 2024-01-24T12:48:16.868 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkstat.o 2024-01-24T12:48:17.027 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] crc32cselftest.o 2024-01-24T12:48:17.110 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] cowextsize.o 2024-01-24T12:48:17.217 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] encrypt.o 2024-01-24T12:48:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] file.o 2024-01-24T12:48:17.536 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] freeze.o 2024-01-24T12:48:17.620 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsuuid.o 2024-01-24T12:48:17.718 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsync.o 2024-01-24T12:48:17.794 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] getrusage.o 2024-01-24T12:48:17.883 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] imap.o 2024-01-24T12:48:17.967 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] inject.o 2024-01-24T12:48:18.062 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] label.o 2024-01-24T12:48:18.168 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] link.o 2024-01-24T12:48:18.245 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mmap.o 2024-01-24T12:48:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] open.o 2024-01-24T12:48:18.719 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] parent.o 2024-01-24T12:48:18.879 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] pread.o 2024-01-24T12:48:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] prealloc.o 2024-01-24T12:48:19.185 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] pwrite.o 2024-01-24T12:48:19.335 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] reflink.o 2024-01-24T12:48:19.460 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] resblks.o 2024-01-24T12:48:19.541 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] scrub.o 2024-01-24T12:48:19.670 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] seek.o 2024-01-24T12:48:19.774 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] shutdown.o 2024-01-24T12:48:19.854 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] stat.o 2024-01-24T12:48:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] swapext.o 2024-01-24T12:48:20.132 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sync.o 2024-01-24T12:48:20.207 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] truncate.o 2024-01-24T12:48:20.285 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] utimes.o 2024-01-24T12:48:20.364 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fadvise.o 2024-01-24T12:48:20.452 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] madvise.o 2024-01-24T12:48:20.541 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] mincore.o 2024-01-24T12:48:20.632 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sendfile.o 2024-01-24T12:48:20.733 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fiemap.o 2024-01-24T12:48:20.884 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] copy_file_range.o 2024-01-24T12:48:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sync_file_range.o 2024-01-24T12:48:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] readdir.o 2024-01-24T12:48:21.168 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_writes.o 2024-01-24T12:48:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fsmap.o 2024-01-24T12:48:21.486 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_io 2024-01-24T12:48:21.669 INFO:teuthology.orchestra.run.smithi195.stdout:Building logprint 2024-01-24T12:48:21.937 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] logprint.o 2024-01-24T12:48:22.071 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_copy.o 2024-01-24T12:48:22.179 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_dump.o 2024-01-24T12:48:22.295 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_misc.o 2024-01-24T12:48:22.799 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_print_all.o 2024-01-24T12:48:23.040 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_print_trans.o 2024-01-24T12:48:23.148 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] log_redo.o 2024-01-24T12:48:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_logprint 2024-01-24T12:48:23.580 INFO:teuthology.orchestra.run.smithi195.stdout:Building mkfs 2024-01-24T12:48:23.672 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] proto.o 2024-01-24T12:48:23.940 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_mkfs.o 2024-01-24T12:48:24.636 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] mkfs.xfs 2024-01-24T12:48:24.825 INFO:teuthology.orchestra.run.smithi195.stdout:Building quota 2024-01-24T12:48:25.193 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.o 2024-01-24T12:48:25.290 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] util.o 2024-01-24T12:48:25.447 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] edit.o 2024-01-24T12:48:25.642 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] free.o 2024-01-24T12:48:25.784 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] linux.o 2024-01-24T12:48:25.857 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] path.o 2024-01-24T12:48:25.963 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] project.o 2024-01-24T12:48:26.103 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] quot.o 2024-01-24T12:48:26.254 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] quota.o 2024-01-24T12:48:26.424 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] report.o 2024-01-24T12:48:26.647 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] state.o 2024-01-24T12:48:26.823 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_quota 2024-01-24T12:48:26.952 INFO:teuthology.orchestra.run.smithi195.stdout:Building mdrestore 2024-01-24T12:48:27.006 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_mdrestore.o 2024-01-24T12:48:27.164 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_mdrestore 2024-01-24T12:48:27.327 INFO:teuthology.orchestra.run.smithi195.stdout:Building repair 2024-01-24T12:48:28.605 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] agheader.o 2024-01-24T12:48:28.807 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] agbtree.o 2024-01-24T12:48:29.037 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] attr_repair.o 2024-01-24T12:48:29.380 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] avl.o 2024-01-24T12:48:29.583 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bulkload.o 2024-01-24T12:48:29.696 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] bmap.o 2024-01-24T12:48:29.838 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] btree.o 2024-01-24T12:48:30.158 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] da_util.o 2024-01-24T12:48:30.367 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dino_chunks.o 2024-01-24T12:48:30.727 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dinode.o 2024-01-24T12:48:31.426 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] dir2.o 2024-01-24T12:48:31.822 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] globals.o 2024-01-24T12:48:31.908 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] incore_bmc.o 2024-01-24T12:48:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] incore.o 2024-01-24T12:48:32.144 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] incore_ext.o 2024-01-24T12:48:32.352 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] incore_ino.o 2024-01-24T12:48:32.608 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.o 2024-01-24T12:48:32.736 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase1.o 2024-01-24T12:48:32.855 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase2.o 2024-01-24T12:48:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase3.o 2024-01-24T12:48:33.168 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase4.o 2024-01-24T12:48:33.344 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase5.o 2024-01-24T12:48:33.588 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase6.o 2024-01-24T12:48:34.411 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase7.o 2024-01-24T12:48:34.537 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] prefetch.o 2024-01-24T12:48:34.861 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] progress.o 2024-01-24T12:48:35.055 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] quotacheck.o 2024-01-24T12:48:35.251 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] rmap.o 2024-01-24T12:48:35.628 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] rt.o 2024-01-24T12:48:35.780 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] sb.o 2024-01-24T12:48:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] scan.o 2024-01-24T12:48:36.739 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] slab.o 2024-01-24T12:48:36.892 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] threads.o 2024-01-24T12:48:36.996 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] versions.o 2024-01-24T12:48:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_repair.o 2024-01-24T12:48:37.407 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_repair 2024-01-24T12:48:37.649 INFO:teuthology.orchestra.run.smithi195.stdout:Building rtcp 2024-01-24T12:48:37.704 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_rtcp.o 2024-01-24T12:48:37.871 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_rtcp 2024-01-24T12:48:37.972 INFO:teuthology.orchestra.run.smithi195.stdout:Building m4 2024-01-24T12:48:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:Building man 2024-01-24T12:48:37.987 INFO:teuthology.orchestra.run.smithi195.stdout:Building man2 2024-01-24T12:48:37.997 INFO:teuthology.orchestra.run.smithi195.stdout:Building man3 2024-01-24T12:48:38.005 INFO:teuthology.orchestra.run.smithi195.stdout:Building man5 2024-01-24T12:48:38.013 INFO:teuthology.orchestra.run.smithi195.stdout:Building man8 2024-01-24T12:48:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] mkfs.xfs.8 2024-01-24T12:48:38.037 INFO:teuthology.orchestra.run.smithi195.stdout:Building doc 2024-01-24T12:48:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: [ZIP] CHANGES.gz 2024-01-24T12:48:38.058 INFO:teuthology.orchestra.run.smithi195.stdout:Building debian 2024-01-24T12:48:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:Building spaceman 2024-01-24T12:48:38.339 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] info.o 2024-01-24T12:48:38.437 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] init.o 2024-01-24T12:48:38.552 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] file.o 2024-01-24T12:48:38.664 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] health.o 2024-01-24T12:48:38.823 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] prealloc.o 2024-01-24T12:48:38.931 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] trim.o 2024-01-24T12:48:39.046 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] freesp.o 2024-01-24T12:48:39.219 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_spaceman 2024-01-24T12:48:39.343 INFO:teuthology.orchestra.run.smithi195.stdout:Building scrub 2024-01-24T12:48:40.040 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] common.o 2024-01-24T12:48:40.181 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] counter.o 2024-01-24T12:48:40.251 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] descr.o 2024-01-24T12:48:40.334 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] disk.o 2024-01-24T12:48:40.453 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] filemap.o 2024-01-24T12:48:40.542 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] fscounters.o 2024-01-24T12:48:40.641 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] inodes.o 2024-01-24T12:48:40.785 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase1.o 2024-01-24T12:48:40.891 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase2.o 2024-01-24T12:48:40.993 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase3.o 2024-01-24T12:48:41.108 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase4.o 2024-01-24T12:48:41.204 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase5.o 2024-01-24T12:48:41.347 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase6.o 2024-01-24T12:48:41.525 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] phase7.o 2024-01-24T12:48:41.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:41.621 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:41.624 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:48:41.644 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] progress.o 2024-01-24T12:48:41.752 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] read_verify.o 2024-01-24T12:48:41.874 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] repair.o 2024-01-24T12:48:41.995 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] scrub.o 2024-01-24T12:48:42.201 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] spacemap.o 2024-01-24T12:48:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] vfs.o 2024-01-24T12:48:42.435 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] xfs_scrub.o 2024-01-24T12:48:42.630 INFO:teuthology.orchestra.run.smithi195.stdout: [CC] unicrash.o 2024-01-24T12:48:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: [LD] xfs_scrub 2024-01-24T12:48:42.992 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] xfs_scrub_all 2024-01-24T12:48:43.001 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] xfs_scrub@.service 2024-01-24T12:48:43.007 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] xfs_scrub_all.service 2024-01-24T12:48:43.013 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] xfs_scrub_fail@.service 2024-01-24T12:48:43.019 INFO:teuthology.orchestra.run.smithi195.stdout: [SED] xfs_scrub_all.cron 2024-01-24T12:48:43.025 INFO:teuthology.orchestra.run.smithi195.stdout:Building po 2024-01-24T12:48:43.052 INFO:teuthology.orchestra.run.smithi195.stdout: [GETTXT] xfsprogs.pot 2024-01-24T12:48:43.292 INFO:teuthology.orchestra.run.smithi195.stdout: [MSGFMT] de.mo 2024-01-24T12:48:43.340 INFO:teuthology.orchestra.run.smithi195.stderr:2345 translated messages. 2024-01-24T12:48:43.342 INFO:teuthology.orchestra.run.smithi195.stdout: [MSGFMT] pl.mo 2024-01-24T12:48:43.387 INFO:teuthology.orchestra.run.smithi195.stderr:3104 translated messages. 2024-01-24T12:48:43.388 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[2]: Nothing to be done for 'include'. 2024-01-24T12:48:43.392 DEBUG:teuthology.orchestra.run.smithi195:> (cd /tmp/tmp.8fLKA1aPwyxfsprogs-dev && exec sudo make install) 2024-01-24T12:48:43.422 INFO:teuthology.orchestra.run.smithi195.stdout:Installing libfrog-install 2024-01-24T12:48:43.847 INFO:teuthology.orchestra.run.smithi195.stdout:Installing libxfs-install 2024-01-24T12:48:45.444 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-01-24T12:48:45.464 INFO:teuthology.orchestra.run.smithi195.stdout:Installing libxlog-install 2024-01-24T12:48:45.552 INFO:teuthology.orchestra.run.smithi195.stdout:Installing libxcmd-install 2024-01-24T12:48:45.681 INFO:teuthology.orchestra.run.smithi195.stdout:Installing libhandle-install 2024-01-24T12:48:45.756 INFO:teuthology.orchestra.run.smithi195.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2024-01-24T12:48:45.817 INFO:teuthology.orchestra.run.smithi195.stdout:Installing copy-install 2024-01-24T12:48:45.868 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2024-01-24T12:48:45.940 INFO:teuthology.orchestra.run.smithi195.stdout:Installing db-install 2024-01-24T12:48:47.918 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:47.937 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2024-01-24T12:48:47.990 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2024-01-24T12:48:48.010 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2024-01-24T12:48:48.029 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2024-01-24T12:48:48.051 INFO:teuthology.orchestra.run.smithi195.stdout:Installing estimate-install 2024-01-24T12:48:48.101 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:48.120 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2024-01-24T12:48:48.166 INFO:teuthology.orchestra.run.smithi195.stdout:Installing fsck-install 2024-01-24T12:48:48.170 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-01-24T12:48:48.189 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2024-01-24T12:48:48.210 INFO:teuthology.orchestra.run.smithi195.stdout:Installing fsr-install 2024-01-24T12:48:48.262 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:48.281 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2024-01-24T12:48:48.328 INFO:teuthology.orchestra.run.smithi195.stdout:Installing growfs-install 2024-01-24T12:48:48.378 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:48.397 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2024-01-24T12:48:48.449 INFO:teuthology.orchestra.run.smithi195.stdout:Installing io-install 2024-01-24T12:48:49.776 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:49.795 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2024-01-24T12:48:49.841 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2024-01-24T12:48:49.886 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2024-01-24T12:48:49.931 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2024-01-24T12:48:49.977 INFO:teuthology.orchestra.run.smithi195.stdout:Installing logprint-install 2024-01-24T12:48:50.242 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:50.264 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2024-01-24T12:48:50.314 INFO:teuthology.orchestra.run.smithi195.stdout:Installing mkfs-install 2024-01-24T12:48:50.403 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-01-24T12:48:50.421 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2024-01-24T12:48:50.473 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2024-01-24T12:48:50.492 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2024-01-24T12:48:50.545 INFO:teuthology.orchestra.run.smithi195.stdout:Installing quota-install 2024-01-24T12:48:50.895 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:50.915 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2024-01-24T12:48:50.962 INFO:teuthology.orchestra.run.smithi195.stdout:Installing mdrestore-install 2024-01-24T12:48:51.012 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:51.031 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2024-01-24T12:48:51.085 INFO:teuthology.orchestra.run.smithi195.stdout:Installing repair-install 2024-01-24T12:48:52.356 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-01-24T12:48:52.375 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2024-01-24T12:48:52.431 INFO:teuthology.orchestra.run.smithi195.stdout:Installing rtcp-install 2024-01-24T12:48:52.480 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:52.499 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2024-01-24T12:48:52.546 INFO:teuthology.orchestra.run.smithi195.stdout:Installing m4-install 2024-01-24T12:48:52.550 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-24T12:48:52.552 INFO:teuthology.orchestra.run.smithi195.stdout:Installing man-install 2024-01-24T12:48:52.562 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[2]: Nothing to be done for 'install'. 2024-01-24T12:48:52.568 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[2]: Nothing to be done for 'install'. 2024-01-24T12:48:52.575 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2024-01-24T12:48:52.601 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2024-01-24T12:48:52.624 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2024-01-24T12:48:52.646 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2024-01-24T12:48:52.675 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2024-01-24T12:48:52.700 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2024-01-24T12:48:52.723 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-01-24T12:48:52.746 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2024-01-24T12:48:52.769 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2024-01-24T12:48:52.791 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2024-01-24T12:48:52.814 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2024-01-24T12:48:52.837 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2024-01-24T12:48:52.860 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2024-01-24T12:48:52.882 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2024-01-24T12:48:52.905 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2024-01-24T12:48:52.928 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2024-01-24T12:48:52.950 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2024-01-24T12:48:52.973 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2024-01-24T12:48:52.996 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2024-01-24T12:48:53.019 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2024-01-24T12:48:53.041 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2024-01-24T12:48:53.064 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2024-01-24T12:48:53.087 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2024-01-24T12:48:53.109 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2024-01-24T12:48:53.132 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2024-01-24T12:48:53.154 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2024-01-24T12:48:53.177 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2024-01-24T12:48:53.200 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2024-01-24T12:48:53.223 INFO:teuthology.orchestra.run.smithi195.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-01-24T12:48:53.243 INFO:teuthology.orchestra.run.smithi195.stdout:Installing doc-install 2024-01-24T12:48:53.247 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-01-24T12:48:53.266 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2024-01-24T12:48:53.296 INFO:teuthology.orchestra.run.smithi195.stdout:Installing debian-install 2024-01-24T12:48:53.300 INFO:teuthology.orchestra.run.smithi195.stdout:gmake[1]: Nothing to be done for 'install'. 2024-01-24T12:48:53.302 INFO:teuthology.orchestra.run.smithi195.stdout:Installing spaceman-install 2024-01-24T12:48:53.570 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:53.589 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2024-01-24T12:48:53.635 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2024-01-24T12:48:53.656 INFO:teuthology.orchestra.run.smithi195.stdout:Installing scrub-install 2024-01-24T12:48:54.347 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-01-24T12:48:54.366 INFO:teuthology.orchestra.run.smithi195.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2024-01-24T12:48:54.412 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2024-01-24T12:48:54.431 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2024-01-24T12:48:54.450 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2024-01-24T12:48:54.486 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2024-01-24T12:48:54.505 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2024-01-24T12:48:54.530 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2024-01-24T12:48:54.549 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2024-01-24T12:48:54.568 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /lib/udev/rules.d 2024-01-24T12:48:54.587 INFO:teuthology.orchestra.run.smithi195.stdout:for i in xfs.rules; do \ 2024-01-24T12:48:54.588 INFO:teuthology.orchestra.run.smithi195.stdout: ../install-sh -o root -g root -m 644 $i /lib/udev/rules.d/64-$i; \ 2024-01-24T12:48:54.588 INFO:teuthology.orchestra.run.smithi195.stdout:done 2024-01-24T12:48:54.609 INFO:teuthology.orchestra.run.smithi195.stdout:Installing po-install 2024-01-24T12:48:54.700 INFO:teuthology.orchestra.run.smithi195.stdout:Installing include-install 2024-01-24T12:48:54.704 INFO:teuthology.orchestra.run.smithi195.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-01-24T12:48:54.723 INFO:teuthology.orchestra.run.smithi195.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-01-24T12:48:54.742 INFO:teuthology.orchestra.run.smithi195.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2024-01-24T12:48:54.765 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2024-01-24T12:48:54.766 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-01-24T12:48:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.900+0000 7fd5ecd58640 1 Processor -- start 2024-01-24T12:48:54.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.900+0000 7fd5ecd58640 1 -- start start 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5ecd58640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd5e814b540 0x7fd5e80bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5ecd58640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5e806a900 0x7fd5e814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5ecd58640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80bc590 con 0x7fd5e806a4c0 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5ecd58640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80bc320 con 0x7fd5e806a900 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5ecd58640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80bb650 con 0x7fd5e814b540 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5e806a900 0x7fd5e814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd5e806a900 0x7fd5e814e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46828/0 (socket says 172.21.15.27:46828) 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 -- 172.21.15.27:0/2198782885 learned_addr learned my addr 172.21.15.27:0/2198782885 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e659c640 1 --2- 172.21.15.27:0/2198782885 >> v2:172.21.15.124:3300/0 conn(0x7fd5e814b540 0x7fd5e80bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 -- 172.21.15.27:0/2198782885 >> v2:172.21.15.124:3300/0 conn(0x7fd5e814b540 msgr2=0x7fd5e80bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 --2- 172.21.15.27:0/2198782885 >> v2:172.21.15.124:3300/0 conn(0x7fd5e814b540 0x7fd5e80bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 -- 172.21.15.27:0/2198782885 >> v1:172.21.15.124:6789/0 conn(0x7fd5e806a4c0 legacy=0x7fd5e814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:54.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.904+0000 7fd5e6d9d640 1 -- 172.21.15.27:0/2198782885 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80b3a10 con 0x7fd5e806a900 2024-01-24T12:48:54.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e6d9d640 1 --2- 172.21.15.27:0/2198782885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a900 0x7fd5e814e6e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80be590 tx=0x7fd5e001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da90ac1635e4b2b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:54.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e559a640 1 -- 172.21.15.27:0/2198782885 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00af400 con 0x7fd5e806a900 2024-01-24T12:48:54.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e559a640 1 -- 172.21.15.27:0/2198782885 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e00ab050 con 0x7fd5e806a900 2024-01-24T12:48:54.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e559a640 1 -- 172.21.15.27:0/2198782885 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00af780 con 0x7fd5e806a900 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- 172.21.15.27:0/2198782885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a900 msgr2=0x7fd5e814e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/2198782885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a900 0x7fd5e814e6e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80be590 tx=0x7fd5e001f1c0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- 172.21.15.27:0/2198782885 shutdown_connections 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/2198782885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a900 0x7fd5e814e6e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/2198782885 >> v2:172.21.15.124:3300/0 conn(0x7fd5e814b540 0x7fd5e80bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- 172.21.15.27:0/2198782885 >> 172.21.15.27:0/2198782885 conn(0x7fd5e80c02e0 msgr2=0x7fd5e80c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- 172.21.15.27:0/2198782885 shutdown_connections 2024-01-24T12:48:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- 172.21.15.27:0/2198782885 wait complete. 2024-01-24T12:48:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 Processor -- start 2024-01-24T12:48:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- start start 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e806a900 0x7fd5e81e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5e814b540 0x7fd5e80b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8149140 con 0x7fd5e806a4c0 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81df7a0 con 0x7fd5e806a900 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5ecd58640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81dfa10 con 0x7fd5e814b540 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46844/0 (socket says 172.21.15.27:46844) 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 -- 172.21.15.27:0/4178339933 learned_addr learned my addr 172.21.15.27:0/4178339933 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:48:54.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e5d9b640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e806a900 0x7fd5e81e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e6d9d640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5e814b540 0x7fd5e80b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 -- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5e814b540 msgr2=0x7fd5e80b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5e814b540 0x7fd5e80b9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 -- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e806a900 msgr2=0x7fd5e81e0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e806a900 0x7fd5e81e0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 -- 172.21.15.27:0/4178339933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0009b30 con 0x7fd5e806a4c0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.908+0000 7fd5e659c640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800e8a0 tx=0x7fd5d800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8009510 con 0x7fd5e806a4c0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800c940 con 0x7fd5e806a4c0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e81dfcf0 con 0x7fd5e806a4c0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800ccb0 con 0x7fd5e806a4c0 2024-01-24T12:48:54.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e80ba420 con 0x7fd5e806a4c0 2024-01-24T12:48:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80ba6a0 con 0x7fd5e806a4c0 2024-01-24T12:48:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5d8013470 con 0x7fd5e806a4c0 2024-01-24T12:48:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 0x7fd5c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5d8083210 con 0x7fd5e806a4c0 2024-01-24T12:48:54.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5e5d9b640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 0x7fd5c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:54.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.912+0000 7fd5e5d9b640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 0x7fd5c8067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80bec70 tx=0x7fd5dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:54.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:54.916+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd5d8050c60 con 0x7fd5e806a4c0 2024-01-24T12:48:55.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.132+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd5e804e000 con 0x7fd5e806a4c0 2024-01-24T12:48:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.132+0000 7fd5d6ffd640 1 -- 172.21.15.27:0/4178339933 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fd5d8054280 con 0x7fd5e806a4c0 2024-01-24T12:48:55.134 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T12:48:55.134 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":1,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","modified":"2024-01-24T12:43:12.362989Z","created":"2024-01-24T12:43:12.362989Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3300","nonce":0},{"type":"v1","addr":"172.21.15.124:6789","nonce":0}]},"addr":"172.21.15.124:6789/0","public_addr":"172.21.15.124:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:3301","nonce":0},{"type":"v1","addr":"172.21.15.124:6790","nonce":0}]},"addr":"172.21.15.124:6790/0","public_addr":"172.21.15.124:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-01-24T12:48:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:dumped monmap epoch 1 2024-01-24T12:48:55.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 msgr2=0x7fd5c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 0x7fd5c8067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80bec70 tx=0x7fd5dc009040 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 msgr2=0x7fd5e80b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800e8a0 tx=0x7fd5d800eca0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 shutdown_connections 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd5c8065a60 0x7fd5c8067f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd5e814b540 0x7fd5e80b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd5e806a900 0x7fd5e81e0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 --2- 172.21.15.27:0/4178339933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd5e806a4c0 0x7fd5e80b75e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 >> 172.21.15.27:0/4178339933 conn(0x7fd5e80c02e0 msgr2=0x7fd5e80bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 shutdown_connections 2024-01-24T12:48:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.136+0000 7fd5ecd58640 1 -- 172.21.15.27:0/4178339933 wait complete. 2024-01-24T12:48:55.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-01-24T12:48:55.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.272+0000 7fe4653fa640 1 Processor -- start 2024-01-24T12:48:55.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.272+0000 7fe4653fa640 1 -- start start 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe4653fa640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 0x7fe4600bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe4653fa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe46006a900 0x7fe46014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe4653fa640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4600bc590 con 0x7fe46006a4c0 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe4653fa640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4600bc320 con 0x7fe46006a900 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe4653fa640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4600bb650 con 0x7fe46014b540 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe46006a900 0x7fe46014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe46006a900 0x7fe46014e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46850/0 (socket says 172.21.15.27:46850) 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45e7fc640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe46006a4c0 0x7fe46014dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:50484/0 (socket says 172.21.15.27:50484) 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 -- 172.21.15.27:0/36273662 learned_addr learned my addr 172.21.15.27:0/36273662 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45effd640 1 --2- 172.21.15.27:0/36273662 >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 0x7fe4600bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 -- 172.21.15.27:0/36273662 >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 msgr2=0x7fe4600bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T12:48:55.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 --2- 172.21.15.27:0/36273662 >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 0x7fe4600bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 -- 172.21.15.27:0/36273662 >> v1:172.21.15.27:6789/0 conn(0x7fe46006a4c0 legacy=0x7fe46014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 -- 172.21.15.27:0/36273662 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600b3a10 con 0x7fe46006a900 2024-01-24T12:48:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45effd640 1 --2- 172.21.15.27:0/36273662 >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 0x7fe4600bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:48:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45f7fe640 1 --2- 172.21.15.27:0/36273662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a900 0x7fe46014e6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe4600be590 tx=0x7fe45801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d376bec863f728db server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45dffb640 1 -- 172.21.15.27:0/36273662 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580af400 con 0x7fe46006a900 2024-01-24T12:48:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45dffb640 1 -- 172.21.15.27:0/36273662 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4580ab050 con 0x7fe46006a900 2024-01-24T12:48:55.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.276+0000 7fe45dffb640 1 -- 172.21.15.27:0/36273662 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580af780 con 0x7fe46006a900 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/36273662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a900 msgr2=0x7fe46014e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- 172.21.15.27:0/36273662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a900 0x7fe46014e6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe4600be590 tx=0x7fe45801f1c0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/36273662 shutdown_connections 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- 172.21.15.27:0/36273662 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a900 0x7fe46014e6e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- 172.21.15.27:0/36273662 >> v2:172.21.15.124:3300/0 conn(0x7fe46014b540 0x7fe4600bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/36273662 >> 172.21.15.27:0/36273662 conn(0x7fe4600c02e0 msgr2=0x7fe4600c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/36273662 shutdown_connections 2024-01-24T12:48:55.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/36273662 wait complete. 2024-01-24T12:48:55.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 Processor -- start 2024-01-24T12:48:55.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- start start 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe46006a900 0x7fe4600ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 0x7fe4600b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600ba550 con 0x7fe46006a4c0 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600b8e20 con 0x7fe46006a900 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600b84f0 con 0x7fe46014b540 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46860/0 (socket says 172.21.15.27:46860) 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 -- 172.21.15.27:0/563190128 learned_addr learned my addr 172.21.15.27:0/563190128 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45e7fc640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe46006a900 0x7fe4600ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45f7fe640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 0x7fe4600b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 -- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 msgr2=0x7fe4600b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 0x7fe4600b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 -- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe46006a900 msgr2=0x7fe4600ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe46006a900 0x7fe4600ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 -- 172.21.15.27:0/563190128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe458009b30 con 0x7fe46006a4c0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45f7fe640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 0x7fe4600b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe45effd640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c820 tx=0x7fe44800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448007a30 con 0x7fe46006a4c0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448007b90 con 0x7fe46006a4c0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44800ce10 con 0x7fe46006a4c0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4600b87d0 con 0x7fe46006a4c0 2024-01-24T12:48:55.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4600b7730 con 0x7fe46006a4c0 2024-01-24T12:48:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.280+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46004e000 con 0x7fe46006a4c0 2024-01-24T12:48:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.284+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4480113f0 con 0x7fe46006a4c0 2024-01-24T12:48:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.284+0000 7fe4577fe640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 0x7fe440067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T12:48:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.284+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe448083350 con 0x7fe46006a4c0 2024-01-24T12:48:55.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.284+0000 7fe45e7fc640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 0x7fe440067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T12:48:55.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.284+0000 7fe45e7fc640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 0x7fe440067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4600bddd0 tx=0x7fe450007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T12:48:55.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.288+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe448050c70 con 0x7fe46006a4c0 2024-01-24T12:48:55.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.496+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fe4600a6260 con 0x7fe46006a4c0 2024-01-24T12:48:55.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.496+0000 7fe4577fe640 1 -- 172.21.15.27:0/563190128 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fe448054290 con 0x7fe46006a4c0 2024-01-24T12:48:55.498 INFO:teuthology.orchestra.run.smithi027.stdout:[client.admin] 2024-01-24T12:48:55.498 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg== 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 msgr2=0x7fe440067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 0x7fe440067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe4600bddd0 tx=0x7fe450007cb0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 msgr2=0x7fe4600a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c820 tx=0x7fe44800cce0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 shutdown_connections 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe440065a60 0x7fe440067f20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe46014b540 0x7fe4600b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe46006a900 0x7fe4600ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 --2- 172.21.15.27:0/563190128 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe46006a4c0 0x7fe4600a4820 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T12:48:55.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 >> 172.21.15.27:0/563190128 conn(0x7fe4600c02e0 msgr2=0x7fe4600a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T12:48:55.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 shutdown_connections 2024-01-24T12:48:55.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T12:48:55.500+0000 7fe4653fa640 1 -- 172.21.15.27:0/563190128 wait complete. 2024-01-24T12:48:55.518 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T12:48:55.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/tmp/tmp.JNJD3eTBcCxfstests-dev/local.config 2024-01-24T12:48:55.538 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.27:6789:/test export TEST_DIR=/tmp/tmp.jay5U8PAbAtest export SCRATCH_DEV=172.21.15.27:6789:/scratch export SCRATCH_MNT=/tmp/tmp.1rpWfC7Ur8scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg==,test_dummy_encryption" 2024-01-24T12:48:55.538 INFO:teuthology.orchestra.run:Running command with timeout 10800 2024-01-24T12:48:55.538 DEBUG:teuthology.orchestra.run.smithi195:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.JNJD3eTBcCxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2024-01-24T12:48:57.242 INFO:teuthology.orchestra.run.smithi195.stdout:FSTYP -- ceph 2024-01-24T12:48:57.252 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM -- Linux/x86_64 smithi195 6.7.0-gf2d346040895 #1 SMP PREEMPT_DYNAMIC Wed Jan 24 04:21:11 UTC 2024 2024-01-24T12:48:57.254 INFO:teuthology.orchestra.run.smithi195.stdout:MKFS_OPTIONS -- 172.21.15.27:6789:/scratch 2024-01-24T12:48:57.256 INFO:teuthology.orchestra.run.smithi195.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg==,test_dummy_encryption 172.21.15.27:6789:/scratch /tmp/tmp.1rpWfC7Ur8scratch 2024-01-24T12:48:57.256 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T12:48:57.385 INFO:teuthology.orchestra.run.smithi195.stdout:ceph/001 [expunged] 2024-01-24T12:48:57.739 INFO:teuthology.orchestra.run.smithi195.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T12:48:58.070 INFO:teuthology.orchestra.run.smithi195.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T12:48:58.507 INFO:teuthology.orchestra.run.smithi195.stdout:ceph/004 0s 2024-01-24T12:48:58.792 INFO:teuthology.orchestra.run.smithi195.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T12:49:08.013 INFO:teuthology.orchestra.run.smithi195.stdout:generic/001 10s 2024-01-24T12:49:08.692 INFO:teuthology.orchestra.run.smithi195.stdout:generic/002 0s 2024-01-24T12:49:08.980 INFO:teuthology.orchestra.run.smithi195.stdout:generic/003 [not run] atime not maintained by ceph 2024-01-24T12:49:09.271 INFO:teuthology.orchestra.run.smithi195.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-01-24T12:49:09.976 INFO:teuthology.orchestra.run.smithi195.stdout:generic/005 0s 2024-01-24T12:49:11.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:11.730 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:11.733 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:42.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:42.097 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:42.099 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:49:49.398 INFO:teuthology.orchestra.run.smithi195.stdout:generic/006 40s 2024-01-24T12:50:12.359 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:50:12.361 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:50:12.364 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:50:42.421 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:50:42.424 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:50:42.427 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:12.544 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:12.548 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:12.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:17.858 INFO:teuthology.orchestra.run.smithi195.stdout:generic/007 88s 2024-01-24T12:51:20.812 INFO:teuthology.orchestra.run.smithi195.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T12:51:23.063 INFO:teuthology.orchestra.run.smithi195.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T12:51:42.875 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:42.879 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:51:42.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:13.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:13.105 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:13.108 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:17.713 INFO:teuthology.orchestra.run.smithi195.stdout:generic/011 54s 2024-01-24T12:52:21.480 INFO:teuthology.orchestra.run.smithi195.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:52:43.161 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:43.163 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:52:43.169 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:09.518 INFO:teuthology.orchestra.run.smithi195.stdout:generic/013 48s 2024-01-24T12:53:09.844 INFO:teuthology.orchestra.run.smithi195.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-01-24T12:53:10.146 INFO:teuthology.orchestra.run.smithi195.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-01-24T12:53:13.163 INFO:teuthology.orchestra.run.smithi195.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:53:13.579 INFO:teuthology.orchestra.run.smithi195.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-01-24T12:53:13.661 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:13.664 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:13.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:18.825 INFO:teuthology.orchestra.run.smithi195.stdout:generic/020 5s 2024-01-24T12:53:22.637 INFO:teuthology.orchestra.run.smithi195.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:53:26.766 INFO:teuthology.orchestra.run.smithi195.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:53:28.668 INFO:teuthology.orchestra.run.smithi195.stdout:generic/023 2s 2024-01-24T12:53:28.991 INFO:teuthology.orchestra.run.smithi195.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-01-24T12:53:29.306 INFO:teuthology.orchestra.run.smithi195.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-01-24T12:53:29.645 INFO:teuthology.orchestra.run.smithi195.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-01-24T12:53:34.975 INFO:teuthology.orchestra.run.smithi195.stdout:generic/028 5s 2024-01-24T12:53:36.179 INFO:teuthology.orchestra.run.smithi195.stdout:generic/029 2s 2024-01-24T12:53:41.400 INFO:teuthology.orchestra.run.smithi195.stdout:generic/030 5s 2024-01-24T12:53:43.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:43.956 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:43.959 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:53:44.071 INFO:teuthology.orchestra.run.smithi195.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-01-24T12:53:44.360 INFO:teuthology.orchestra.run.smithi195.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T12:53:47.525 INFO:teuthology.orchestra.run.smithi195.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T12:53:47.826 INFO:teuthology.orchestra.run.smithi195.stdout:generic/034 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:53:48.213 INFO:teuthology.orchestra.run.smithi195.stdout:generic/035 1s 2024-01-24T12:53:55.055 INFO:teuthology.orchestra.run.smithi195.stdout:generic/037 7s 2024-01-24T12:53:55.430 INFO:teuthology.orchestra.run.smithi195.stdout:generic/039 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:53:55.725 INFO:teuthology.orchestra.run.smithi195.stdout:generic/040 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:53:56.035 INFO:teuthology.orchestra.run.smithi195.stdout:generic/041 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:53:56.445 INFO:teuthology.orchestra.run.smithi195.stdout:generic/042 [not run] ceph does not support shutdown 2024-01-24T12:53:56.850 INFO:teuthology.orchestra.run.smithi195.stdout:generic/050 [not run] ceph does not support shutdown 2024-01-24T12:53:57.269 INFO:teuthology.orchestra.run.smithi195.stdout:generic/052 [not run] ceph does not support shutdown 2024-01-24T12:53:58.171 INFO:teuthology.orchestra.run.smithi195.stdout:generic/053 1s 2024-01-24T12:53:58.547 INFO:teuthology.orchestra.run.smithi195.stdout:generic/056 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:53:58.879 INFO:teuthology.orchestra.run.smithi195.stdout:generic/057 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:54:02.261 INFO:teuthology.orchestra.run.smithi195.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:54:02.564 INFO:teuthology.orchestra.run.smithi195.stdout:generic/059 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:54:06.439 INFO:teuthology.orchestra.run.smithi195.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:54:09.784 INFO:teuthology.orchestra.run.smithi195.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:54:12.257 INFO:teuthology.orchestra.run.smithi195.stdout:generic/062 3s 2024-01-24T12:54:14.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:54:14.013 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:54:14.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:54:16.146 INFO:teuthology.orchestra.run.smithi195.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T12:54:16.492 INFO:teuthology.orchestra.run.smithi195.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-24T12:54:16.797 INFO:teuthology.orchestra.run.smithi195.stdout:generic/065 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:54:17.103 INFO:teuthology.orchestra.run.smithi195.stdout:generic/066 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:54:17.446 INFO:teuthology.orchestra.run.smithi195.stdout:generic/067 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:54:40.984 INFO:teuthology.orchestra.run.smithi195.stdout:generic/069 23s 2024-01-24T12:54:44.383 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:54:44.386 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:54:44.390 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:04.367 INFO:teuthology.orchestra.run.smithi195.stdout:generic/070 23s 2024-01-24T12:55:04.660 INFO:teuthology.orchestra.run.smithi195.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T12:55:04.987 INFO:teuthology.orchestra.run.smithi195.stdout:generic/073 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:55:14.569 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:14.572 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:14.574 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:44.650 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:44.653 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:44.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:55:47.550 INFO:teuthology.orchestra.run.smithi195.stdout:generic/075 42s 2024-01-24T12:55:47.823 INFO:teuthology.orchestra.run.smithi195.stdout:generic/076 [not run] require 172.21.15.27:6789:/scratch to be local device 2024-01-24T12:55:48.165 INFO:teuthology.orchestra.run.smithi195.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-01-24T12:55:48.471 INFO:teuthology.orchestra.run.smithi195.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-01-24T12:55:50.814 INFO:teuthology.orchestra.run.smithi195.stdout:generic/080 2s 2024-01-24T12:55:51.179 INFO:teuthology.orchestra.run.smithi195.stdout:generic/081 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:55:51.464 INFO:teuthology.orchestra.run.smithi195.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T12:55:57.575 INFO:teuthology.orchestra.run.smithi195.stdout:generic/084 6s 2024-01-24T12:55:57.929 INFO:teuthology.orchestra.run.smithi195.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T12:55:58.348 INFO:teuthology.orchestra.run.smithi195.stdout:generic/087 1s 2024-01-24T12:55:58.676 INFO:teuthology.orchestra.run.smithi195.stdout:generic/088 0s 2024-01-24T12:55:58.980 INFO:teuthology.orchestra.run.smithi195.stdout:generic/090 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:56:14.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:56:14.726 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:56:14.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:56:44.777 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:56:44.780 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:56:44.783 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:14.877 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:14.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:14.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:44.967 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:44.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:57:44.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:06.414 INFO:teuthology.orchestra.run.smithi195.stdout:generic/091 127s 2024-01-24T12:58:06.703 INFO:teuthology.orchestra.run.smithi195.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T12:58:07.082 INFO:teuthology.orchestra.run.smithi195.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-24T12:58:09.696 INFO:teuthology.orchestra.run.smithi195.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T12:58:10.325 INFO:teuthology.orchestra.run.smithi195.stdout:generic/097 1s 2024-01-24T12:58:11.377 INFO:teuthology.orchestra.run.smithi195.stdout:generic/098 1s 2024-01-24T12:58:13.006 INFO:teuthology.orchestra.run.smithi195.stdout:generic/099 2s 2024-01-24T12:58:13.310 INFO:teuthology.orchestra.run.smithi195.stdout:generic/101 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:58:13.610 INFO:teuthology.orchestra.run.smithi195.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T12:58:13.916 INFO:teuthology.orchestra.run.smithi195.stdout:generic/104 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:58:14.712 INFO:teuthology.orchestra.run.smithi195.stdout:generic/105 1s 2024-01-24T12:58:15.070 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:15.073 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:15.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:15.122 INFO:teuthology.orchestra.run.smithi195.stdout:generic/106 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:58:15.462 INFO:teuthology.orchestra.run.smithi195.stdout:generic/107 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:58:15.983 INFO:teuthology.orchestra.run.smithi195.stdout:generic/108 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T12:58:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T12:58:16.640 INFO:teuthology.orchestra.run.smithi195.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T12:58:45.205 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:45.209 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:58:45.211 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:01.634 INFO:teuthology.orchestra.run.smithi195.stdout:generic/112 45s 2024-01-24T12:59:15.271 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:15.274 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:15.276 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:45.336 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:45.339 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T12:59:45.341 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:15.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:15.432 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:15.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:45.887 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:45.889 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:45.891 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:00:55.826 INFO:teuthology.orchestra.run.smithi195.stdout:generic/113 114s 2024-01-24T13:00:56.111 INFO:teuthology.orchestra.run.smithi195.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-01-24T13:00:56.438 INFO:teuthology.orchestra.run.smithi195.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:00:56.766 INFO:teuthology.orchestra.run.smithi195.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:08.534 INFO:teuthology.orchestra.run.smithi195.stdout:generic/117 12s 2024-01-24T13:01:08.913 INFO:teuthology.orchestra.run.smithi195.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:09.242 INFO:teuthology.orchestra.run.smithi195.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:09.523 INFO:teuthology.orchestra.run.smithi195.stdout:generic/120 [not run] atime not maintained by ceph 2024-01-24T13:01:09.845 INFO:teuthology.orchestra.run.smithi195.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:01:10.180 INFO:teuthology.orchestra.run.smithi195.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:01:10.882 INFO:teuthology.orchestra.run.smithi195.stdout:generic/123 0s 2024-01-24T13:01:15.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:01:15.971 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:01:15.977 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:01:16.146 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:01:16.150+0000 7ff7a375e640 -1 Fail to open '/proc/37031/cmdline' error = (2) No such file or directory 2024-01-24T13:01:16.146 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:01:16.150+0000 7ff7a375e640 -1 received signal: Hangup from (PID: 37031) UID: 0 2024-01-24T13:01:16.147 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:01:16.150+0000 7fd7f5fcc640 -1 Fail to open '/proc/37031/cmdline' error = (2) No such file or directory 2024-01-24T13:01:16.147 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:01:16.150+0000 7fd7f5fcc640 -1 received signal: Hangup from (PID: 37031) UID: 0 2024-01-24T13:01:50.081 INFO:teuthology.orchestra.run.smithi195.stdout:generic/124 40s 2024-01-24T13:01:50.617 INFO:teuthology.orchestra.run.smithi195.stdout:generic/126 0s 2024-01-24T13:01:51.962 INFO:teuthology.orchestra.run.smithi195.stdout:generic/128 1s 2024-01-24T13:01:52.310 INFO:teuthology.orchestra.run.smithi195.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-01-24T13:01:52.608 INFO:teuthology.orchestra.run.smithi195.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-01-24T13:01:54.142 INFO:teuthology.orchestra.run.smithi195.stdout:generic/131 2s 2024-01-24T13:01:54.489 INFO:teuthology.orchestra.run.smithi195.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:55.699 INFO:teuthology.orchestra.run.smithi195.stdout:generic/135 1s 2024-01-24T13:01:56.097 INFO:teuthology.orchestra.run.smithi195.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:01:56.436 INFO:teuthology.orchestra.run.smithi195.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:56.761 INFO:teuthology.orchestra.run.smithi195.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:57.086 INFO:teuthology.orchestra.run.smithi195.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:58.171 INFO:teuthology.orchestra.run.smithi195.stdout:generic/141 1s 2024-01-24T13:01:58.567 INFO:teuthology.orchestra.run.smithi195.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:58.894 INFO:teuthology.orchestra.run.smithi195.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:59.244 INFO:teuthology.orchestra.run.smithi195.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:59.576 INFO:teuthology.orchestra.run.smithi195.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:01:59.911 INFO:teuthology.orchestra.run.smithi195.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:00.244 INFO:teuthology.orchestra.run.smithi195.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:00.564 INFO:teuthology.orchestra.run.smithi195.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:00.892 INFO:teuthology.orchestra.run.smithi195.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:01.211 INFO:teuthology.orchestra.run.smithi195.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:01.546 INFO:teuthology.orchestra.run.smithi195.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:01.853 INFO:teuthology.orchestra.run.smithi195.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:02.178 INFO:teuthology.orchestra.run.smithi195.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:02.498 INFO:teuthology.orchestra.run.smithi195.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:02.817 INFO:teuthology.orchestra.run.smithi195.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:03.142 INFO:teuthology.orchestra.run.smithi195.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:03.477 INFO:teuthology.orchestra.run.smithi195.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:03.829 INFO:teuthology.orchestra.run.smithi195.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:02:04.107 INFO:teuthology.orchestra.run.smithi195.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-01-24T13:02:04.430 INFO:teuthology.orchestra.run.smithi195.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-01-24T13:02:04.994 INFO:teuthology.orchestra.run.smithi195.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:05.464 INFO:teuthology.orchestra.run.smithi195.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:02:06.048 INFO:teuthology.orchestra.run.smithi195.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:02:07.152 INFO:teuthology.orchestra.run.smithi195.stdout:generic/169 1s 2024-01-24T13:02:07.750 INFO:teuthology.orchestra.run.smithi195.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:08.419 INFO:teuthology.orchestra.run.smithi195.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:09.021 INFO:teuthology.orchestra.run.smithi195.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:09.594 INFO:teuthology.orchestra.run.smithi195.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:18.220 INFO:teuthology.orchestra.run.smithi195.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:02:18.577 INFO:teuthology.orchestra.run.smithi195.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:18.893 INFO:teuthology.orchestra.run.smithi195.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:19.228 INFO:teuthology.orchestra.run.smithi195.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:19.572 INFO:teuthology.orchestra.run.smithi195.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:02:19.896 INFO:teuthology.orchestra.run.smithi195.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:02:20.553 INFO:teuthology.orchestra.run.smithi195.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:20.892 INFO:teuthology.orchestra.run.smithi195.stdout:generic/184 0s 2024-01-24T13:02:21.511 INFO:teuthology.orchestra.run.smithi195.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:22.032 INFO:teuthology.orchestra.run.smithi195.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:22.674 INFO:teuthology.orchestra.run.smithi195.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:23.192 INFO:teuthology.orchestra.run.smithi195.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:23.802 INFO:teuthology.orchestra.run.smithi195.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:25.073 INFO:teuthology.orchestra.run.smithi195.stdout:generic/193 2s 2024-01-24T13:02:25.760 INFO:teuthology.orchestra.run.smithi195.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:26.312 INFO:teuthology.orchestra.run.smithi195.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:02:27.489 INFO:teuthology.orchestra.run.smithi195.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:02.887 INFO:teuthology.orchestra.run.smithi195.stdout:generic/198 35s 2024-01-24T13:03:03.427 INFO:teuthology.orchestra.run.smithi195.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:03.998 INFO:teuthology.orchestra.run.smithi195.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:04.568 INFO:teuthology.orchestra.run.smithi195.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:05.147 INFO:teuthology.orchestra.run.smithi195.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:05.688 INFO:teuthology.orchestra.run.smithi195.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:06.344 INFO:teuthology.orchestra.run.smithi195.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:06.977 INFO:teuthology.orchestra.run.smithi195.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:32.687 INFO:teuthology.orchestra.run.smithi195.stdout:generic/207 25s 2024-01-24T13:03:33.165 INFO:teuthology.orchestra.run.smithi195.stdout:generic/210 1s 2024-01-24T13:03:33.965 INFO:teuthology.orchestra.run.smithi195.stdout:generic/211 0s 2024-01-24T13:03:34.407 INFO:teuthology.orchestra.run.smithi195.stdout:generic/212 1s 2024-01-24T13:03:34.726 INFO:teuthology.orchestra.run.smithi195.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:03:35.049 INFO:teuthology.orchestra.run.smithi195.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:03:37.416 INFO:teuthology.orchestra.run.smithi195.stdout:generic/215 2s 2024-01-24T13:03:38.079 INFO:teuthology.orchestra.run.smithi195.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:38.663 INFO:teuthology.orchestra.run.smithi195.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:39.179 INFO:teuthology.orchestra.run.smithi195.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:39.470 INFO:teuthology.orchestra.run.smithi195.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:03:40.246 INFO:teuthology.orchestra.run.smithi195.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:41.584 INFO:teuthology.orchestra.run.smithi195.stdout:generic/221 1s 2024-01-24T13:03:42.127 INFO:teuthology.orchestra.run.smithi195.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:42.452 INFO:teuthology.orchestra.run.smithi195.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:03:42.806 INFO:teuthology.orchestra.run.smithi195.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-24T13:03:43.394 INFO:teuthology.orchestra.run.smithi195.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:43.717 INFO:teuthology.orchestra.run.smithi195.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:03:44.291 INFO:teuthology.orchestra.run.smithi195.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:44.578 INFO:teuthology.orchestra.run.smithi195.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:03:44.860 INFO:teuthology.orchestra.run.smithi195.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:03:46.256 INFO:teuthology.orchestra.run.smithi195.stdout:generic/236 2s 2024-01-24T13:03:46.671 INFO:teuthology.orchestra.run.smithi195.stdout:generic/237 0s 2024-01-24T13:03:47.357 INFO:teuthology.orchestra.run.smithi195.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:03:47.651 INFO:teuthology.orchestra.run.smithi195.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-01-24T13:03:47.910 INFO:teuthology.orchestra.run.smithi195.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:03:48.351 INFO:teuthology.orchestra.run.smithi195.stdout:generic/245 1s 2024-01-24T13:03:48.680 INFO:teuthology.orchestra.run.smithi195.stdout:generic/246 0s 2024-01-24T13:04:15.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:15.494 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:15.497 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:45.586 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:45.588 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:04:45.590 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:15.845 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:15.847 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:15.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:46.065 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:46.068 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:05:46.071 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:16.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:16.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:16.171 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:46.247 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:46.254 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:06:46.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:16.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:16.379 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:16.381 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:46.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:46.761 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:07:46.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:17.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:17.159 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:17.162 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:25.120 INFO:teuthology.orchestra.run.smithi195.stdout:generic/247 277s 2024-01-24T13:08:25.516 INFO:teuthology.orchestra.run.smithi195.stdout:generic/248 0s 2024-01-24T13:08:47.222 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:47.225 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:47.229 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:08:53.330 INFO:teuthology.orchestra.run.smithi195.stdout:generic/249 28s 2024-01-24T13:08:53.637 INFO:teuthology.orchestra.run.smithi195.stdout:generic/250 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:08:53.953 INFO:teuthology.orchestra.run.smithi195.stdout:generic/252 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:08:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:08:55.321 INFO:teuthology.orchestra.run.smithi195.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:09:05.007 INFO:teuthology.orchestra.run.smithi195.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:09:17.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:09:17.314 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:09:17.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:09:17.686 INFO:teuthology.orchestra.run.smithi195.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:09:18.815 INFO:teuthology.orchestra.run.smithi195.stdout:generic/257 1s 2024-01-24T13:09:19.088 INFO:teuthology.orchestra.run.smithi195.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-01-24T13:09:19.719 INFO:teuthology.orchestra.run.smithi195.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:09:20.125 INFO:teuthology.orchestra.run.smithi195.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.1rpWfC7Ur8scratch 2024-01-24T13:09:20.765 INFO:teuthology.orchestra.run.smithi195.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:09:21.442 INFO:teuthology.orchestra.run.smithi195.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:09:47.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:09:47.603 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:09:47.605 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:17.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:17.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:17.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:47.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:47.974 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:10:47.976 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:18.048 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:18.052 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:18.055 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:35.452 INFO:teuthology.orchestra.run.smithi195.stdout:generic/263 134s 2024-01-24T13:11:36.233 INFO:teuthology.orchestra.run.smithi195.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:36.918 INFO:teuthology.orchestra.run.smithi195.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:37.590 INFO:teuthology.orchestra.run.smithi195.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:38.249 INFO:teuthology.orchestra.run.smithi195.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:38.961 INFO:teuthology.orchestra.run.smithi195.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:39.654 INFO:teuthology.orchestra.run.smithi195.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:40.335 INFO:teuthology.orchestra.run.smithi195.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:41.058 INFO:teuthology.orchestra.run.smithi195.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:41.348 INFO:teuthology.orchestra.run.smithi195.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-01-24T13:11:42.122 INFO:teuthology.orchestra.run.smithi195.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:42.847 INFO:teuthology.orchestra.run.smithi195.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:43.554 INFO:teuthology.orchestra.run.smithi195.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:44.305 INFO:teuthology.orchestra.run.smithi195.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:45.037 INFO:teuthology.orchestra.run.smithi195.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:45.663 INFO:teuthology.orchestra.run.smithi195.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:45.951 INFO:teuthology.orchestra.run.smithi195.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:11:46.578 INFO:teuthology.orchestra.run.smithi195.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:46.967 INFO:teuthology.orchestra.run.smithi195.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.1rpWfC7Ur8scratch 2024-01-24T13:11:47.544 INFO:teuthology.orchestra.run.smithi195.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:48.167 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:48.169 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:48.171 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:11:48.287 INFO:teuthology.orchestra.run.smithi195.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:48.961 INFO:teuthology.orchestra.run.smithi195.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:49.646 INFO:teuthology.orchestra.run.smithi195.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:50.308 INFO:teuthology.orchestra.run.smithi195.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:51.047 INFO:teuthology.orchestra.run.smithi195.stdout:generic/294 1s 2024-01-24T13:11:51.826 INFO:teuthology.orchestra.run.smithi195.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:52.487 INFO:teuthology.orchestra.run.smithi195.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:53.112 INFO:teuthology.orchestra.run.smithi195.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:53.698 INFO:teuthology.orchestra.run.smithi195.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:11:54.381 INFO:teuthology.orchestra.run.smithi195.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:11:55.008 INFO:teuthology.orchestra.run.smithi195.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:11:55.812 INFO:teuthology.orchestra.run.smithi195.stdout:generic/306 0s 2024-01-24T13:11:57.882 INFO:teuthology.orchestra.run.smithi195.stdout:generic/307 2s 2024-01-24T13:11:58.278 INFO:teuthology.orchestra.run.smithi195.stdout:generic/308 1s 2024-01-24T13:11:59.663 INFO:teuthology.orchestra.run.smithi195.stdout:generic/309 1s 2024-01-24T13:11:59.940 INFO:teuthology.orchestra.run.smithi195.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:12:04.326 INFO:teuthology.orchestra.run.smithi195.stdout:generic/313 5s 2024-01-24T13:12:04.948 INFO:teuthology.orchestra.run.smithi195.stdout:generic/314 0s 2024-01-24T13:12:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:12:13.982 INFO:teuthology.orchestra.run.smithi195.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:12:15.111 INFO:teuthology.orchestra.run.smithi195.stdout:generic/317 - output mismatch (see /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/317.out.bad) 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: --- tests/generic/317.out 2024-01-24 12:44:59.217321493 +0000 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: +++ /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/317.out.bad 2024-01-24 13:12:15.109482196 +0000 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: @@ -4,9 +4,7 @@ 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 0 Filetype: Regular File 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: From user_ns 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: - File: "$SCRATCH_MNT/file1" 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: - Size: 0 Filetype: Regular File 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2024-01-24T13:12:15.117 INFO:teuthology.orchestra.run.smithi195.stdout: +execvp: Permission denied 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: *** Remounting *** 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: @@ -15,6 +13,4 @@ 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 0 Filetype: Regular File 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: From user_ns 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: - File: "$SCRATCH_MNT/file1" 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: - Size: 0 Filetype: Regular File 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2024-01-24T13:12:15.118 INFO:teuthology.orchestra.run.smithi195.stdout: +execvp: Permission denied 2024-01-24T13:12:15.992 INFO:teuthology.orchestra.run.smithi195.stdout:generic/318 0s 2024-01-24T13:12:16.574 INFO:teuthology.orchestra.run.smithi195.stdout:generic/319 0s 2024-01-24T13:12:16.946 INFO:teuthology.orchestra.run.smithi195.stdout:generic/321 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:17.240 INFO:teuthology.orchestra.run.smithi195.stdout:generic/322 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:17.510 INFO:teuthology.orchestra.run.smithi195.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-01-24T13:12:17.818 INFO:teuthology.orchestra.run.smithi195.stdout:generic/325 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:18.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:12:18.421 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:12:18.424 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:12:18.473 INFO:teuthology.orchestra.run.smithi195.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:19.178 INFO:teuthology.orchestra.run.smithi195.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:19.865 INFO:teuthology.orchestra.run.smithi195.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:20.570 INFO:teuthology.orchestra.run.smithi195.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:21.229 INFO:teuthology.orchestra.run.smithi195.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:21.929 INFO:teuthology.orchestra.run.smithi195.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:22.564 INFO:teuthology.orchestra.run.smithi195.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:12:22.860 INFO:teuthology.orchestra.run.smithi195.stdout:generic/335 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:23.191 INFO:teuthology.orchestra.run.smithi195.stdout:generic/336 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:24.006 INFO:teuthology.orchestra.run.smithi195.stdout:generic/337 1s 2024-01-24T13:12:24.370 INFO:teuthology.orchestra.run.smithi195.stdout:generic/338 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:24.660 INFO:teuthology.orchestra.run.smithi195.stdout:generic/341 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:24.975 INFO:teuthology.orchestra.run.smithi195.stdout:generic/342 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:25.295 INFO:teuthology.orchestra.run.smithi195.stdout:generic/343 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:12:48.513 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:12:48.515 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:12:48.517 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:18.594 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:18.597 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:18.600 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:48.666 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:48.669 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:13:48.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:18.718 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:18.720 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:18.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:48.829 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:48.832 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:14:48.834 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:19.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:19.269 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:19.271 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:48.209 INFO:teuthology.orchestra.run.smithi195.stdout:generic/346 203s 2024-01-24T13:15:48.618 INFO:teuthology.orchestra.run.smithi195.stdout:generic/347 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:15:48.957 INFO:teuthology.orchestra.run.smithi195.stdout:generic/348 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:15:49.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:49.327 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:49.329 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:15:49.710 INFO:teuthology.orchestra.run.smithi195.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:15:50.659 INFO:teuthology.orchestra.run.smithi195.stdout:generic/355 1s 2024-01-24T13:15:51.204 INFO:teuthology.orchestra.run.smithi195.stdout:generic/356 [not run] swapfiles are not supported 2024-01-24T13:15:51.748 INFO:teuthology.orchestra.run.smithi195.stdout:generic/357 [not run] swapfiles are not supported 2024-01-24T13:15:52.425 INFO:teuthology.orchestra.run.smithi195.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:15:52.993 INFO:teuthology.orchestra.run.smithi195.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:15:53.362 INFO:teuthology.orchestra.run.smithi195.stdout:generic/360 0s 2024-01-24T13:15:53.680 INFO:teuthology.orchestra.run.smithi195.stdout:generic/361 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:15:53.973 INFO:teuthology.orchestra.run.smithi195.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:54.238 INFO:teuthology.orchestra.run.smithi195.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:54.515 INFO:teuthology.orchestra.run.smithi195.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:54.788 INFO:teuthology.orchestra.run.smithi195.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:55.084 INFO:teuthology.orchestra.run.smithi195.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:55.370 INFO:teuthology.orchestra.run.smithi195.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:55.658 INFO:teuthology.orchestra.run.smithi195.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:55.948 INFO:teuthology.orchestra.run.smithi195.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:56.236 INFO:teuthology.orchestra.run.smithi195.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-01-24T13:15:56.518 INFO:teuthology.orchestra.run.smithi195.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:15:57.137 INFO:teuthology.orchestra.run.smithi195.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:15:57.730 INFO:teuthology.orchestra.run.smithi195.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:15:58.221 INFO:teuthology.orchestra.run.smithi195.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:15:58.827 INFO:teuthology.orchestra.run.smithi195.stdout:generic/375 0s 2024-01-24T13:15:59.138 INFO:teuthology.orchestra.run.smithi195.stdout:generic/376 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:16:00.005 INFO:teuthology.orchestra.run.smithi195.stdout:generic/377 0s 2024-01-24T13:16:00.568 INFO:teuthology.orchestra.run.smithi195.stdout:generic/378 0s 2024-01-24T13:16:00.853 INFO:teuthology.orchestra.run.smithi195.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:01.146 INFO:teuthology.orchestra.run.smithi195.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:01.430 INFO:teuthology.orchestra.run.smithi195.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:01.716 INFO:teuthology.orchestra.run.smithi195.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:01.988 INFO:teuthology.orchestra.run.smithi195.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:02.281 INFO:teuthology.orchestra.run.smithi195.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:02.585 INFO:teuthology.orchestra.run.smithi195.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:02.855 INFO:teuthology.orchestra.run.smithi195.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:03.156 INFO:teuthology.orchestra.run.smithi195.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-01-24T13:16:03.452 INFO:teuthology.orchestra.run.smithi195.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:16:03.881 INFO:teuthology.orchestra.run.smithi195.stdout:generic/392 [not run] ceph does not support shutdown 2024-01-24T13:16:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:generic/393 2s 2024-01-24T13:16:05.651 INFO:teuthology.orchestra.run.smithi195.stdout:generic/394 0s 2024-01-24T13:16:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:06.444 INFO:teuthology.orchestra.run.smithi195.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:06.847 INFO:teuthology.orchestra.run.smithi195.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:07.227 INFO:teuthology.orchestra.run.smithi195.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:07.492 INFO:teuthology.orchestra.run.smithi195.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:16:08.439 INFO:teuthology.orchestra.run.smithi195.stdout:generic/401 1s 2024-01-24T13:16:08.949 INFO:teuthology.orchestra.run.smithi195.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-01-24T13:16:10.155 INFO:teuthology.orchestra.run.smithi195.stdout:generic/403 2s 2024-01-24T13:16:10.522 INFO:teuthology.orchestra.run.smithi195.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:16:13.471 INFO:teuthology.orchestra.run.smithi195.stdout:generic/406 3s 2024-01-24T13:16:13.899 INFO:teuthology.orchestra.run.smithi195.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:16:14.250 INFO:teuthology.orchestra.run.smithi195.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:16:14.548 INFO:teuthology.orchestra.run.smithi195.stdout:generic/409 [not run] require 172.21.15.27:6789:/scratch to be local device 2024-01-24T13:16:14.831 INFO:teuthology.orchestra.run.smithi195.stdout:generic/410 [not run] require 172.21.15.27:6789:/scratch to be local device 2024-01-24T13:16:15.147 INFO:teuthology.orchestra.run.smithi195.stdout:generic/411 [not run] require 172.21.15.27:6789:/scratch to be local device 2024-01-24T13:16:16.163 INFO:teuthology.orchestra.run.smithi195.stdout:generic/412 1s 2024-01-24T13:16:16.662 INFO:teuthology.orchestra.run.smithi195.stdout:generic/413 [not run] mount 172.21.15.27:6789:/scratch with dax failed 2024-01-24T13:16:17.362 INFO:teuthology.orchestra.run.smithi195.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:16:17.749 INFO:teuthology.orchestra.run.smithi195.stdout:generic/417 [not run] ceph does not support shutdown 2024-01-24T13:16:18.150 INFO:teuthology.orchestra.run.smithi195.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:19.435 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:16:19.437 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:16:19.440 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:16:31.822 INFO:teuthology.orchestra.run.smithi195.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:16:32.211 INFO:teuthology.orchestra.run.smithi195.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:16:32.527 INFO:teuthology.orchestra.run.smithi195.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:16:33.015 INFO:teuthology.orchestra.run.smithi195.stdout:generic/423 1s 2024-01-24T13:16:33.317 INFO:teuthology.orchestra.run.smithi195.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2024-01-24T13:16:33.692 INFO:teuthology.orchestra.run.smithi195.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-01-24T13:16:49.549 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:16:49.551 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:16:49.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:09.308 INFO:teuthology.orchestra.run.smithi195.stdout:generic/426 36s 2024-01-24T13:17:10.296 INFO:teuthology.orchestra.run.smithi195.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-01-24T13:17:10.639 INFO:teuthology.orchestra.run.smithi195.stdout:generic/428 0s 2024-01-24T13:17:11.084 INFO:teuthology.orchestra.run.smithi195.stdout:generic/430 1s 2024-01-24T13:17:11.498 INFO:teuthology.orchestra.run.smithi195.stdout:generic/431 0s 2024-01-24T13:17:11.948 INFO:teuthology.orchestra.run.smithi195.stdout:generic/432 0s 2024-01-24T13:17:12.361 INFO:teuthology.orchestra.run.smithi195.stdout:generic/433 1s 2024-01-24T13:17:12.792 INFO:teuthology.orchestra.run.smithi195.stdout:generic/434 0s 2024-01-24T13:17:13.539 INFO:teuthology.orchestra.run.smithi195.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:17:14.635 INFO:teuthology.orchestra.run.smithi195.stdout:generic/437 1s 2024-01-24T13:17:20.387 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:20.389 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:20.392 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:22.942 INFO:teuthology.orchestra.run.smithi195.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:17:23.358 INFO:teuthology.orchestra.run.smithi195.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:17:23.699 INFO:teuthology.orchestra.run.smithi195.stdout:generic/441 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:17:24.021 INFO:teuthology.orchestra.run.smithi195.stdout:generic/443 1s 2024-01-24T13:17:24.415 INFO:teuthology.orchestra.run.smithi195.stdout:generic/444 0s 2024-01-24T13:17:25.113 INFO:teuthology.orchestra.run.smithi195.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:17:32.827 INFO:teuthology.orchestra.run.smithi195.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:17:33.935 INFO:teuthology.orchestra.run.smithi195.stdout:generic/448 1s 2024-01-24T13:17:34.286 INFO:teuthology.orchestra.run.smithi195.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-01-24T13:17:42.364 INFO:teuthology.orchestra.run.smithi195.stdout:generic/450 8s 2024-01-24T13:17:51.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:51.043 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:17:51.046 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:12.930 INFO:teuthology.orchestra.run.smithi195.stdout:generic/451 30s 2024-01-24T13:18:14.705 INFO:teuthology.orchestra.run.smithi195.stdout:generic/452 2s 2024-01-24T13:18:15.016 INFO:teuthology.orchestra.run.smithi195.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-01-24T13:18:15.339 INFO:teuthology.orchestra.run.smithi195.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-01-24T13:18:15.662 INFO:teuthology.orchestra.run.smithi195.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:18:16.321 INFO:teuthology.orchestra.run.smithi195.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:18:21.097 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:21.100 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:21.102 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:51.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:51.193 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:18:51.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:21.393 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:21.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:21.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:51.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:51.680 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:19:51.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:21.826 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:21.847 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:21.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:51.916 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:51.918 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:20:51.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:22.001 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:22.004 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:22.006 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:52.245 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:52.248 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:21:52.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:22.350 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:22.361 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:22.363 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:44.773 INFO:teuthology.orchestra.run.smithi195.stdout:generic/460 268s 2024-01-24T13:22:45.233 INFO:teuthology.orchestra.run.smithi195.stdout:generic/462 [not run] mount 172.21.15.27:6789:/scratch with dax failed 2024-01-24T13:22:45.619 INFO:teuthology.orchestra.run.smithi195.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:22:52.267 INFO:teuthology.orchestra.run.smithi195.stdout:generic/465 7s 2024-01-24T13:22:52.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:52.493 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:52.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:22:52.602 INFO:teuthology.orchestra.run.smithi195.stdout:generic/466 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:22:56.386 INFO:teuthology.orchestra.run.smithi195.stdout:generic/467 4s 2024-01-24T13:22:58.159 INFO:teuthology.orchestra.run.smithi195.stdout:generic/468 [not run] ceph does not support shutdown 2024-01-24T13:22:58.507 INFO:teuthology.orchestra.run.smithi195.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:22:58.844 INFO:teuthology.orchestra.run.smithi195.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-01-24T13:23:22.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:23:22.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:23:22.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:23:53.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:23:53.195 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:23:53.198 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:02.852 INFO:teuthology.orchestra.run.smithi195.stdout:generic/471 64s 2024-01-24T13:24:03.716 INFO:teuthology.orchestra.run.smithi195.stdout:generic/472 [not run] swapfiles are not supported 2024-01-24T13:24:04.127 INFO:teuthology.orchestra.run.smithi195.stdout:generic/474 [not run] ceph does not support shutdown 2024-01-24T13:24:11.442 INFO:teuthology.orchestra.run.smithi195.stdout:generic/477 7s 2024-01-24T13:24:22.891 INFO:teuthology.orchestra.run.smithi195.stdout:generic/478 11s 2024-01-24T13:24:23.255 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:23.258 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:23.261 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:23.279 INFO:teuthology.orchestra.run.smithi195.stdout:generic/479 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:23.613 INFO:teuthology.orchestra.run.smithi195.stdout:generic/480 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:23.904 INFO:teuthology.orchestra.run.smithi195.stdout:generic/481 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:24.198 INFO:teuthology.orchestra.run.smithi195.stdout:generic/483 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:24.489 INFO:teuthology.orchestra.run.smithi195.stdout:generic/484 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:24.831 INFO:teuthology.orchestra.run.smithi195.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:24:26.241 INFO:teuthology.orchestra.run.smithi195.stdout:generic/486 2s 2024-01-24T13:24:26.580 INFO:teuthology.orchestra.run.smithi195.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-01-24T13:24:26.846 INFO:teuthology.orchestra.run.smithi195.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-01-24T13:24:27.173 INFO:teuthology.orchestra.run.smithi195.stdout:generic/489 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:28.273 INFO:teuthology.orchestra.run.smithi195.stdout:generic/490 1s 2024-01-24T13:24:28.587 INFO:teuthology.orchestra.run.smithi195.stdout:generic/491 [not run] ceph does not support freezing 2024-01-24T13:24:28.885 INFO:teuthology.orchestra.run.smithi195.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-01-24T13:24:29.560 INFO:teuthology.orchestra.run.smithi195.stdout:generic/493 [not run] swapfiles are not supported 2024-01-24T13:24:30.110 INFO:teuthology.orchestra.run.smithi195.stdout:generic/494 [not run] swapfiles are not supported 2024-01-24T13:24:30.655 INFO:teuthology.orchestra.run.smithi195.stdout:generic/495 [not run] swapfiles are not supported 2024-01-24T13:24:31.202 INFO:teuthology.orchestra.run.smithi195.stdout:generic/496 [not run] swapfiles are not supported 2024-01-24T13:24:31.763 INFO:teuthology.orchestra.run.smithi195.stdout:generic/497 [not run] swapfiles are not supported 2024-01-24T13:24:32.093 INFO:teuthology.orchestra.run.smithi195.stdout:generic/498 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:32.396 INFO:teuthology.orchestra.run.smithi195.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:24:33.067 INFO:teuthology.orchestra.run.smithi195.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:24:33.389 INFO:teuthology.orchestra.run.smithi195.stdout:generic/502 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:33.694 INFO:teuthology.orchestra.run.smithi195.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:24:34.083 INFO:teuthology.orchestra.run.smithi195.stdout:generic/504 1s 2024-01-24T13:24:34.495 INFO:teuthology.orchestra.run.smithi195.stdout:generic/505 [not run] ceph does not support shutdown 2024-01-24T13:24:34.820 INFO:teuthology.orchestra.run.smithi195.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:24:35.124 INFO:teuthology.orchestra.run.smithi195.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-01-24T13:24:35.419 INFO:teuthology.orchestra.run.smithi195.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-01-24T13:24:35.749 INFO:teuthology.orchestra.run.smithi195.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-01-24T13:24:36.065 INFO:teuthology.orchestra.run.smithi195.stdout:generic/510 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:36.358 INFO:teuthology.orchestra.run.smithi195.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-01-24T13:24:36.677 INFO:teuthology.orchestra.run.smithi195.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:24:37.306 INFO:teuthology.orchestra.run.smithi195.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:24:37.938 INFO:teuthology.orchestra.run.smithi195.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:24:38.510 INFO:teuthology.orchestra.run.smithi195.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:24:38.827 INFO:teuthology.orchestra.run.smithi195.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-01-24T13:24:39.276 INFO:teuthology.orchestra.run.smithi195.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:24:39.983 INFO:teuthology.orchestra.run.smithi195.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:24:40.281 INFO:teuthology.orchestra.run.smithi195.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-01-24T13:24:40.575 INFO:teuthology.orchestra.run.smithi195.stdout:generic/520 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:24:41.315 INFO:teuthology.orchestra.run.smithi195.stdout:generic/523 1s 2024-01-24T13:24:53.883 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:53.886 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:24:53.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:24.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:24.253 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:24.255 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:54.420 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:54.422 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:25:54.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:24.568 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:24.570 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:24.698 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:54.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:54.842 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:26:54.864 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:24.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:24.942 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:24.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:32.314 INFO:teuthology.orchestra.run.smithi195.stdout:generic/524 171s 2024-01-24T13:27:32.808 INFO:teuthology.orchestra.run.smithi195.stdout:generic/525 [not run] filesystem does not support huge file size 2024-01-24T13:27:33.174 INFO:teuthology.orchestra.run.smithi195.stdout:generic/526 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:27:33.513 INFO:teuthology.orchestra.run.smithi195.stdout:generic/527 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:27:33.920 INFO:teuthology.orchestra.run.smithi195.stdout:generic/528 0s 2024-01-24T13:27:34.887 INFO:teuthology.orchestra.run.smithi195.stdout:generic/529 1s 2024-01-24T13:27:35.330 INFO:teuthology.orchestra.run.smithi195.stdout:generic/530 [not run] ceph does not support shutdown 2024-01-24T13:27:35.614 INFO:teuthology.orchestra.run.smithi195.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-01-24T13:27:35.949 INFO:teuthology.orchestra.run.smithi195.stdout:generic/532 0s 2024-01-24T13:27:36.913 INFO:teuthology.orchestra.run.smithi195.stdout:generic/533 1s 2024-01-24T13:27:37.222 INFO:teuthology.orchestra.run.smithi195.stdout:generic/534 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:27:37.524 INFO:teuthology.orchestra.run.smithi195.stdout:generic/535 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:27:37.927 INFO:teuthology.orchestra.run.smithi195.stdout:generic/536 [not run] ceph does not support shutdown 2024-01-24T13:27:38.355 INFO:teuthology.orchestra.run.smithi195.stdout:generic/537 [not run] FSTRIM not supported 2024-01-24T13:27:55.303 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:55.306 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:27:55.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:25.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:25.395 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:25.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:55.515 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:55.518 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:28:55.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:25.578 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:25.582 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:25.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:55.703 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:55.707 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:29:55.709 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:25.833 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:25.836 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:25.838 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:55.899 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:55.903 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:30:55.905 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:26.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:26.023 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:26.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:56.192 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:56.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:31:56.198 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:26.264 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:26.267 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:26.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:56.338 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:56.341 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:32:56.344 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:26.402 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:26.406 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:26.409 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:56.551 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:56.554 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:33:56.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:26.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:26.667 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:26.670 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:56.721 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:56.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:34:56.727 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:26.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:26.873 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:26.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:56.931 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:56.935 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:35:56.937 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:27.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:27.022 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:27.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:57.136 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:57.139 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:36:57.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:27.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:27.245 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:27.248 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:57.307 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:57.310 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:37:57.443 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:27.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:27.507 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:27.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:57.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:57.631 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:38:57.634 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:27.755 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:27.758 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:27.761 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:57.876 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:57.880 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:39:57.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:27.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:28.000 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:28.002 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:58.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:58.130 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:40:58.132 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:28.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:28.252 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:28.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:58.313 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:58.316 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:41:58.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:28.441 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:28.444 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:28.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:58.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:58.578 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:42:58.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:00.571 INFO:teuthology.orchestra.run.smithi195.stdout:generic/538 922s 2024-01-24T13:43:13.347 INFO:teuthology.orchestra.run.smithi195.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:43:14.042 INFO:teuthology.orchestra.run.smithi195.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:15.311 INFO:teuthology.orchestra.run.smithi195.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:16.013 INFO:teuthology.orchestra.run.smithi195.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:16.748 INFO:teuthology.orchestra.run.smithi195.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:17.051 INFO:teuthology.orchestra.run.smithi195.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-01-24T13:43:17.370 INFO:teuthology.orchestra.run.smithi195.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:43:17.706 INFO:teuthology.orchestra.run.smithi195.stdout:generic/547 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:43:18.104 INFO:teuthology.orchestra.run.smithi195.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:18.505 INFO:teuthology.orchestra.run.smithi195.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:18.901 INFO:teuthology.orchestra.run.smithi195.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:19.255 INFO:teuthology.orchestra.run.smithi195.stdout:generic/552 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:43:19.628 INFO:teuthology.orchestra.run.smithi195.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-01-24T13:43:20.238 INFO:teuthology.orchestra.run.smithi195.stdout:generic/554 [not run] swapfiles are not supported 2024-01-24T13:43:20.567 INFO:teuthology.orchestra.run.smithi195.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-01-24T13:43:20.869 INFO:teuthology.orchestra.run.smithi195.stdout:generic/556 [not run] ceph does not support casefold feature 2024-01-24T13:43:21.182 INFO:teuthology.orchestra.run.smithi195.stdout:generic/557 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:43:21.509 INFO:teuthology.orchestra.run.smithi195.stdout:generic/563 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:43:22.105 INFO:teuthology.orchestra.run.smithi195.stdout:generic/564 1s 2024-01-24T13:43:22.882 INFO:teuthology.orchestra.run.smithi195.stdout:generic/565 0s 2024-01-24T13:43:23.142 INFO:teuthology.orchestra.run.smithi195.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:28.724 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:28.727 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:28.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:31.666 INFO:teuthology.orchestra.run.smithi195.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T13:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:43:32.248 INFO:teuthology.orchestra.run.smithi195.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:43:32.528 INFO:teuthology.orchestra.run.smithi195.stdout:generic/570 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:43:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:generic/571 [not run] Require fcntl setlease support 2024-01-24T13:43:33.114 INFO:teuthology.orchestra.run.smithi195.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:33.431 INFO:teuthology.orchestra.run.smithi195.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:33.724 INFO:teuthology.orchestra.run.smithi195.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:34.004 INFO:teuthology.orchestra.run.smithi195.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:34.355 INFO:teuthology.orchestra.run.smithi195.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:34.643 INFO:teuthology.orchestra.run.smithi195.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-01-24T13:43:35.026 INFO:teuthology.orchestra.run.smithi195.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-01-24T13:43:35.407 INFO:teuthology.orchestra.run.smithi195.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:36.357 INFO:teuthology.orchestra.run.smithi195.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:36.768 INFO:teuthology.orchestra.run.smithi195.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:37.524 INFO:teuthology.orchestra.run.smithi195.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:37.942 INFO:teuthology.orchestra.run.smithi195.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T13:43:38.266 INFO:teuthology.orchestra.run.smithi195.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:39.011 INFO:teuthology.orchestra.run.smithi195.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:43:39.451 INFO:teuthology.orchestra.run.smithi195.stdout:generic/591 0s 2024-01-24T13:43:39.832 INFO:teuthology.orchestra.run.smithi195.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:40.211 INFO:teuthology.orchestra.run.smithi195.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:40.503 INFO:teuthology.orchestra.run.smithi195.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:40.893 INFO:teuthology.orchestra.run.smithi195.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:41.196 INFO:teuthology.orchestra.run.smithi195.stdout:generic/596 [not run] accton utility required, skipped this test 2024-01-24T13:43:42.178 INFO:teuthology.orchestra.run.smithi195.stdout:generic/597 1s 2024-01-24T13:43:43.233 INFO:teuthology.orchestra.run.smithi195.stdout:generic/598 1s 2024-01-24T13:43:43.645 INFO:teuthology.orchestra.run.smithi195.stdout:generic/599 [not run] ceph does not support shutdown 2024-01-24T13:43:43.937 INFO:teuthology.orchestra.run.smithi195.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:44.219 INFO:teuthology.orchestra.run.smithi195.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:44.611 INFO:teuthology.orchestra.run.smithi195.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:43:44.896 INFO:teuthology.orchestra.run.smithi195.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T13:43:49.169 INFO:teuthology.orchestra.run.smithi195.stdout:generic/604 5s 2024-01-24T13:43:51.355 INFO:teuthology.orchestra.run.smithi195.stdout:generic/605 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed 2024-01-24T13:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout:generic/606 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed 2024-01-24T13:43:52.195 INFO:teuthology.orchestra.run.smithi195.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-01-24T13:43:52.606 INFO:teuthology.orchestra.run.smithi195.stdout:generic/608 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed 2024-01-24T13:43:53.252 INFO:teuthology.orchestra.run.smithi195.stdout:generic/609 1s 2024-01-24T13:43:58.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:58.783 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:43:58.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:06.879 INFO:teuthology.orchestra.run.smithi195.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T13:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout:generic/611 1s 2024-01-24T13:44:08.009 INFO:teuthology.orchestra.run.smithi195.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T13:44:08.385 INFO:teuthology.orchestra.run.smithi195.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:44:08.835 INFO:teuthology.orchestra.run.smithi195.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-01-24T13:44:09.725 INFO:teuthology.orchestra.run.smithi195.stdout:generic/618 1s 2024-01-24T13:44:10.089 INFO:teuthology.orchestra.run.smithi195.stdout:generic/620 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:44:10.467 INFO:teuthology.orchestra.run.smithi195.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T13:44:10.881 INFO:teuthology.orchestra.run.smithi195.stdout:generic/623 [not run] ceph does not support shutdown 2024-01-24T13:44:11.185 INFO:teuthology.orchestra.run.smithi195.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-01-24T13:44:11.493 INFO:teuthology.orchestra.run.smithi195.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-01-24T13:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-01-24T13:44:12.484 INFO:teuthology.orchestra.run.smithi195.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout:generic/629 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:44:13.252 INFO:teuthology.orchestra.run.smithi195.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:44:15.094 INFO:teuthology.orchestra.run.smithi195.stdout:generic/632 2s 2024-01-24T13:44:16.949 INFO:teuthology.orchestra.run.smithi195.stdout:generic/633 1s 2024-01-24T13:44:18.345 INFO:teuthology.orchestra.run.smithi195.stdout:generic/634 2s 2024-01-24T13:44:18.819 INFO:teuthology.orchestra.run.smithi195.stdout:generic/635 [not run] ceph does not support shutdown 2024-01-24T13:44:19.338 INFO:teuthology.orchestra.run.smithi195.stdout:generic/636 [not run] swapfiles are not supported 2024-01-24T13:44:20.153 INFO:teuthology.orchestra.run.smithi195.stdout:generic/637 1s 2024-01-24T13:44:20.512 INFO:teuthology.orchestra.run.smithi195.stdout:generic/638 0s 2024-01-24T13:44:21.349 INFO:teuthology.orchestra.run.smithi195.stdout:generic/639 1s 2024-01-24T13:44:21.641 INFO:teuthology.orchestra.run.smithi195.stdout:generic/640 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T13:44:22.179 INFO:teuthology.orchestra.run.smithi195.stdout:generic/641 [not run] swapfiles are not supported 2024-01-24T13:44:22.559 INFO:teuthology.orchestra.run.smithi195.stdout:generic/644 0s 2024-01-24T13:44:29.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:29.196 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:29.199 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:59.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:59.308 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:44:59.310 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:29.530 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:29.534 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:29.536 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:59.588 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:59.591 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:45:59.594 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:46:29.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:46:29.905 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:46:29.908 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:00.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:00.059 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:00.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:30.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:30.205 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:47:30.208 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:00.481 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:00.484 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:00.486 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:30.635 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:30.639 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:30.642 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:48:30.666 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:48:30.665+0000 7ff7a375e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37367) UID: 0 2024-01-24T13:48:30.666 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:48:30.665+0000 7fd7f5fcc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37367) UID: 0 2024-01-24T13:49:50.716 INFO:teuthology.orchestra.run.smithi195.stdout:generic/645 328s 2024-01-24T13:49:51.305 INFO:teuthology.orchestra.run.smithi195.stdout:generic/646 [not run] ceph does not support shutdown 2024-01-24T13:49:51.886 INFO:teuthology.orchestra.run.smithi195.stdout:generic/647 0s 2024-01-24T13:49:52.564 INFO:teuthology.orchestra.run.smithi195.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:53.134 INFO:teuthology.orchestra.run.smithi195.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:53.794 INFO:teuthology.orchestra.run.smithi195.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:54.517 INFO:teuthology.orchestra.run.smithi195.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:55.133 INFO:teuthology.orchestra.run.smithi195.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:55.704 INFO:teuthology.orchestra.run.smithi195.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:56.339 INFO:teuthology.orchestra.run.smithi195.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:57.052 INFO:teuthology.orchestra.run.smithi195.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:57.703 INFO:teuthology.orchestra.run.smithi195.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:58.294 INFO:teuthology.orchestra.run.smithi195.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:58.932 INFO:teuthology.orchestra.run.smithi195.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:49:59.548 INFO:teuthology.orchestra.run.smithi195.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:00.148 INFO:teuthology.orchestra.run.smithi195.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:00.846 INFO:teuthology.orchestra.run.smithi195.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:01.495 INFO:teuthology.orchestra.run.smithi195.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:02.205 INFO:teuthology.orchestra.run.smithi195.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:02.900 INFO:teuthology.orchestra.run.smithi195.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:03.560 INFO:teuthology.orchestra.run.smithi195.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:04.413 INFO:teuthology.orchestra.run.smithi195.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:50:04.944 INFO:teuthology.orchestra.run.smithi195.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-01-24T13:50:05.744 INFO:teuthology.orchestra.run.smithi195.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T13:51:14.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:51:14.576 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:51:14.579 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:51:44.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:51:44.732 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:51:44.735 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:52:14.857 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:52:14.860 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:52:14.863 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:52:14.876 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:52:14.875+0000 7ff7a375e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37385) UID: 0 2024-01-24T13:52:14.876 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:52:14.875+0000 7fd7f5fcc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37385) UID: 0 2024-01-24T13:54:47.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:54:47.174 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:54:47.176 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:54:47.190 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:54:47.191+0000 7ff7a375e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37392) UID: 0 2024-01-24T13:54:47.190 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:54:47.191+0000 7fd7f5fcc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37392) UID: 0 2024-01-24T13:57:04.990 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:04.993 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:04.996 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:35.313 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:35.316 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:35.318 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T13:57:35.332 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T13:57:35.331+0000 7fd7f5fcc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37409) UID: 0 2024-01-24T13:57:35.332 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T13:57:35.331+0000 7ff7a375e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37409) UID: 0 2024-01-24T14:00:07.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:07.044 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:07.047 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:08.194 INFO:teuthology.orchestra.run.smithi195.stdout:generic/676 603s 2024-01-24T14:00:08.510 INFO:teuthology.orchestra.run.smithi195.stdout:generic/677 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T14:00:08.948 INFO:teuthology.orchestra.run.smithi195.stdout:generic/678 [not run] kernel does not support IO_URING 2024-01-24T14:00:09.236 INFO:teuthology.orchestra.run.smithi195.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T14:00:09.930 INFO:teuthology.orchestra.run.smithi195.stdout:generic/680 0s 2024-01-24T14:00:10.203 INFO:teuthology.orchestra.run.smithi195.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T14:00:10.464 INFO:teuthology.orchestra.run.smithi195.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-01-24T14:00:10.832 INFO:teuthology.orchestra.run.smithi195.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T14:00:17.332 INFO:teuthology.orchestra.run.smithi195.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-01-24T14:00:25.161 INFO:teuthology.orchestra.run.smithi195.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-01-24T14:00:31.111 INFO:teuthology.orchestra.run.smithi195.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-01-24T14:00:37.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:37.155 DEBUG:teuthology.orchestra.run.smithi124:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:37.157 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-24T14:00:37.171 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-24T14:00:37.170+0000 7fd7f5fcc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37419) UID: 0 2024-01-24T14:00:37.171 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-24T14:00:37.170+0000 7ff7a375e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37419) UID: 0 2024-01-24T14:00:37.629 INFO:teuthology.orchestra.run.smithi195.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-01-24T14:00:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T14:00:38.439 INFO:teuthology.orchestra.run.smithi195.stdout:generic/689 0s 2024-01-24T14:00:38.758 INFO:teuthology.orchestra.run.smithi195.stdout:generic/690 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T14:00:39.060 INFO:teuthology.orchestra.run.smithi195.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-01-24T14:00:39.435 INFO:teuthology.orchestra.run.smithi195.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-01-24T14:00:39.734 INFO:teuthology.orchestra.run.smithi195.stdout:generic/695 [not run] require 172.21.15.27:6789:/scratch to be valid block disk 2024-01-24T14:00:40.297 INFO:teuthology.orchestra.run.smithi195.stdout:generic/696 1s 2024-01-24T14:00:40.667 INFO:teuthology.orchestra.run.smithi195.stdout:generic/697 0s 2024-01-24T14:00:42.245 INFO:teuthology.orchestra.run.smithi195.stdout:generic/698 2s 2024-01-24T14:00:43.213 INFO:teuthology.orchestra.run.smithi195.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2024-01-24T14:00:43.549 INFO:teuthology.orchestra.run.smithi195.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-01-24T14:00:44.353 INFO:teuthology.orchestra.run.smithi195.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-01-24T14:00:44.693 INFO:teuthology.orchestra.run.smithi195.stdout:generic/703 [not run] kernel does not support IO_URING 2024-01-24T14:00:45.073 INFO:teuthology.orchestra.run.smithi195.stdout:generic/704 [not run] require 172.21.15.27:6789:/test to be valid block disk 2024-01-24T14:00:46.084 INFO:teuthology.orchestra.run.smithi195.stdout:generic/706 1s 2024-01-24T14:00:46.523 INFO:teuthology.orchestra.run.smithi195.stdout:generic/708 0s 2024-01-24T14:00:46.860 INFO:teuthology.orchestra.run.smithi195.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:47.174 INFO:teuthology.orchestra.run.smithi195.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:47.499 INFO:teuthology.orchestra.run.smithi195.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:47.837 INFO:teuthology.orchestra.run.smithi195.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:48.154 INFO:teuthology.orchestra.run.smithi195.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-01-24T14:00:48.468 INFO:teuthology.orchestra.run.smithi195.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:48.770 INFO:teuthology.orchestra.run.smithi195.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-01-24T14:00:49.094 INFO:teuthology.orchestra.run.smithi195.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:49.404 INFO:teuthology.orchestra.run.smithi195.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:49.721 INFO:teuthology.orchestra.run.smithi195.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:50.031 INFO:teuthology.orchestra.run.smithi195.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:50.349 INFO:teuthology.orchestra.run.smithi195.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:50.683 INFO:teuthology.orchestra.run.smithi195.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-01-24T14:00:51.000 INFO:teuthology.orchestra.run.smithi195.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-01-24T14:00:51.314 INFO:teuthology.orchestra.run.smithi195.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-01-24T14:00:51.624 INFO:teuthology.orchestra.run.smithi195.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-01-24T14:00:51.942 INFO:teuthology.orchestra.run.smithi195.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-01-24T14:00:52.307 INFO:teuthology.orchestra.run.smithi195.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-01-24T14:00:52.701 INFO:teuthology.orchestra.run.smithi195.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-01-24T14:00:57.093 INFO:teuthology.orchestra.run.smithi195.stdout:generic/728 5s 2024-01-24T14:00:57.677 INFO:teuthology.orchestra.run.smithi195.stdout:generic/729 0s 2024-01-24T14:00:57.992 INFO:teuthology.orchestra.run.smithi195.stdout:generic/730 [not run] require 172.21.15.27:6789:/test to be valid block disk 2024-01-24T14:00:58.291 INFO:teuthology.orchestra.run.smithi195.stdout:generic/731 [not run] require 172.21.15.27:6789:/test to be valid block disk 2024-01-24T14:00:59.283 INFO:teuthology.orchestra.run.smithi195.stdout:generic/732 1s 2024-01-24T14:00:59.614 INFO:teuthology.orchestra.run.smithi195.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-01-24T14:00:59.966 INFO:teuthology.orchestra.run.smithi195.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-01-24T14:01:00.328 INFO:teuthology.orchestra.run.smithi195.stdout:generic/736 - output mismatch (see /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/736.out.bad) 2024-01-24T14:01:00.333 INFO:teuthology.orchestra.run.smithi195.stdout: --- tests/generic/736.out 2024-01-24 12:44:59.269319468 +0000 2024-01-24T14:01:00.333 INFO:teuthology.orchestra.run.smithi195.stdout: +++ /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/736.out.bad 2024-01-24 14:01:00.325789947 +0000 2024-01-24T14:01:00.333 INFO:teuthology.orchestra.run.smithi195.stdout: @@ -1,2 +1,4 @@ 2024-01-24T14:01:00.334 INFO:teuthology.orchestra.run.smithi195.stdout: QA output created by 736 2024-01-24T14:01:00.334 INFO:teuthology.orchestra.run.smithi195.stdout: +*** buffer overflow detected ***: terminated 2024-01-24T14:01:00.334 INFO:teuthology.orchestra.run.smithi195.stdout: +/tmp/tmp.JNJD3eTBcCxfstests-dev/tests/generic/736: line 32: 228405 Aborted $here/src/readdir-while-renames $target_dir 2024-01-24T14:01:00.334 INFO:teuthology.orchestra.run.smithi195.stdout: Silence is golden 2024-01-24T14:01:00.760 INFO:teuthology.orchestra.run.smithi195.stdout:generic/737 [not run] ceph does not support shutdown 2024-01-24T14:01:01.074 INFO:teuthology.orchestra.run.smithi195.stdout:generic/738 [not run] ceph does not support freezing 2024-01-24T14:01:01.373 INFO:teuthology.orchestra.run.smithi195.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2024-01-24T14:01:01.675 INFO:teuthology.orchestra.run.smithi195.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2024-01-24T14:01:01.691 INFO:teuthology.orchestra.run.smithi195.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 shared/002 shared/032 2024-01-24T14:01:01.692 INFO:teuthology.orchestra.run.smithi195.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 shared/002 shared/032 2024-01-24T14:01:01.692 INFO:teuthology.orchestra.run.smithi195.stdout:Failures: generic/317 generic/736 2024-01-24T14:01:01.692 INFO:teuthology.orchestra.run.smithi195.stdout:Failed 2 of 603 tests 2024-01-24T14:01:01.720 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-01-24T14:01:02.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T14:01:02.711 INFO:tasks.cephfs.test_fscrypt:Command failed. 2024-01-24T14:01:02.711 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2024-01-24T14:01:02.712 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi195 6.7.0-gf2d346040895 #1 SMP PREEMPT_DYNAMIC Wed Jan 24 04:21:11 UTC 2024 MKFS_OPTIONS -- 172.21.15.27:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQDgBbFlqHluIxAA7SoYX53gAeeKVwOiDdspFg==,test_dummy_encryption 172.21.15.27:6789:/scratch /tmp/tmp.1rpWfC7Ur8scratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 0s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 10s generic/002 0s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 0s generic/006 40s generic/007 88s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 54s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 48s generic/014 [not run] Sparse files are not supported or do not work as expected generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 5s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 5s generic/029 2s generic/030 5s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/035 1s generic/037 7s generic/039 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 3s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/069 23s generic/070 23s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/075 42s generic/076 [not run] require 172.21.15.27:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 2s generic/081 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 1s generic/088 0s generic/090 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/091 127s generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 1s generic/098 1s generic/099 2s generic/101 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/105 1s generic/106 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 45s generic/113 114s generic/114 [not run] Sparse files are not supported or do not work as expected generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 12s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 0s generic/124 40s generic/126 0s generic/128 1s generic/129 [not run] Sparse files are not supported or do not work as expected generic/130 [not run] Sparse files are not supported or do not work as expected generic/131 2s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 1s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 1s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 0s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 2s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 35s generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 25s generic/210 1s generic/211 0s generic/212 1s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 2s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 1s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 2s generic/237 0s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 [not run] Sparse files are not supported or do not work as expected generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 1s generic/246 0s generic/247 277s generic/248 0s generic/249 28s generic/250 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 1s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.1rpWfC7Ur8scratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 134s generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.1rpWfC7Ur8scratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 0s generic/307 2s generic/308 1s generic/309 1s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 5s generic/314 0s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 - output mismatch (see /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/317.out.bad) --- tests/generic/317.out 2024-01-24 12:44:59.217321493 +0000 +++ /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/317.out.bad 2024-01-24 13:12:15.109482196 +0000 @@ -4,9 +4,7 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied *** Remounting *** @@ -15,6 +13,4 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied generic/318 0s generic/319 0s generic/321 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/337 1s generic/338 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/346 203s generic/347 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 0s generic/361 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 0s generic/376 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/377 0s generic/378 0s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 2s generic/394 0s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 2s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 3s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.27:6789:/scratch to be local device generic/410 [not run] require 172.21.15.27:6789:/scratch to be local device generic/411 [not run] require 172.21.15.27:6789:/scratch to be local device generic/412 1s generic/413 [not run] mount 172.21.15.27:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 1s generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 36s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 0s generic/430 1s generic/431 0s generic/432 0s generic/433 1s generic/434 0s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 1s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/443 1s generic/444 0s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 1s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 8s generic/451 30s generic/452 2s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 268s generic/462 [not run] mount 172.21.15.27:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 7s generic/466 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/467 4s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 64s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 7s generic/478 11s generic/479 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 2s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 1s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/523 1s generic/524 171s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/528 0s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 0s generic/533 1s generic/534 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 922s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/564 1s generic/565 0s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 0s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] accton utility required, skipped this test generic/597 1s generic/598 1s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 5s generic/605 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.27:6789:/scratch with dax=always failed generic/609 1s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 2s generic/633 1s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 1s generic/638 0s generic/639 1s generic/640 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 0s generic/645 328s generic/646 [not run] ceph does not support shutdown generic/647 0s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 603s generic/677 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 0s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 0s generic/690 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.27:6789:/scratch to be valid block disk generic/696 1s generic/697 0s generic/698 2s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.27:6789:/test to be valid block disk generic/706 1s generic/708 0s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 5s generic/729 0s generic/730 [not run] require 172.21.15.27:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.27:6789:/test to be valid block disk generic/732 1s generic/734 [not run] Reflink not supported by test filesystem type: ceph generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/736 - output mismatch (see /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/736.out.bad) --- tests/generic/736.out 2024-01-24 12:44:59.269319468 +0000 +++ /tmp/tmp.JNJD3eTBcCxfstests-dev/results//generic/736.out.bad 2024-01-24 14:01:00.325789947 +0000 @@ -1,2 +1,4 @@ QA output created by 736 +*** buffer overflow detected ***: terminated +/tmp/tmp.JNJD3eTBcCxfstests-dev/tests/generic/736: line 32: 228405 Aborted $here/src/readdir-while-renames $target_dir Silence is golden generic/737 [not run] ceph does not support shutdown generic/738 [not run] ceph does not support freezing shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 shared/002 shared/032 Failures: generic/317 generic/736 Failed 2 of 603 tests 2024-01-24T14:01:02.712 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2024-01-24T14:01:02.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo userdel --force --remove fsgqa 2024-01-24T14:01:02.800 INFO:teuthology.orchestra.run.smithi195.stderr:userdel: user fsgqa is currently used by process 218602 2024-01-24T14:01:02.809 INFO:teuthology.orchestra.run.smithi195.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-01-24T14:01:03.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo userdel --force --remove 123456-fsgqa 2024-01-24T14:01:03.177 INFO:teuthology.orchestra.run.smithi195.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-01-24T14:01:03.178 INFO:teuthology.orchestra.run.smithi195.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-01-24T14:01:03.472 DEBUG:teuthology.orchestra.run.smithi195:> sudo groupdel fsgqa 2024-01-24T14:01:03.537 INFO:teuthology.orchestra.run.smithi195.stderr:groupdel: group 'fsgqa' does not exist 2024-01-24T14:01:03.539 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-01-24T14:01:03.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:03.539 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.JNJD3eTBcCxfstests-dev/results) 2024-01-24T14:01:03.607 INFO:teuthology.orchestra.run.smithi195.stdout: File: /tmp/tmp.JNJD3eTBcCxfstests-dev/results 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 801h/2049d Inode: 800228 Links: 5 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-01-24 12:48:57.200822082 +0000 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-01-24 14:01:01.685763010 +0000 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-01-24 14:01:01.685763010 +0000 2024-01-24T14:01:03.608 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-01-24 12:48:57.200822082 +0000 2024-01-24T14:01:03.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:03.610 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-01-24T14:01:03.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:03.678 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.JNJD3eTBcCxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-01-24T14:01:04.110 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.JNJD3eTBcCxfstests-dev to /var/log/ceph. 2024-01-24T14:01:04.111 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf /tmp/tmp.JNJD3eTBcCxfstests-dev 2024-01-24T14:01:04.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf /tmp/tmp.8fLKA1aPwyxfsprogs-dev 2024-01-24T14:01:04.573 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-24T14:01:04.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T14:01:04.699 DEBUG:teuthology.orchestra.run.smithi124:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T14:01:04.805 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-24T14:01:04.964 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-24T14:01:04.964 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T14:01:04.965 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T14:01:04.984 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T14:01:04.984 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T14:01:05.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T14:01:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 Processor -- start 2024-01-24T14:01:05.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 -- start start 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fca28070010 0x7fca28070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca28071180 con 0x7fca28071610 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca280b9c10 con 0x7fca28141700 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2e52b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca280ba1d0 con 0x7fca28070010 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca277fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fca28071610 0x7fca28147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40952/0 (socket says 172.21.15.27:40952) 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca277fe640 1 -- 172.21.15.27:0/1835982141 learned_addr learned my addr 172.21.15.27:0/1835982141 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca27fff640 1 --2- 172.21.15.27:0/1835982141 >> v2:172.21.15.124:3300/0 conn(0x7fca28070010 0x7fca28070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409021860 0 0) 0x7fca28071180 con 0x7fca28071610 2024-01-24T14:01:05.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca08003530 con 0x7fca28071610 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298179691 0 0) 0x7fca08003530 con 0x7fca28071610 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 >> v2:172.21.15.124:3300/0 conn(0x7fca28070010 msgr2=0x7fca28070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 --2- 172.21.15.27:0/1835982141 >> v2:172.21.15.124:3300/0 conn(0x7fca28070010 0x7fca28070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 >> v1:172.21.15.124:6789/0 conn(0x7fca28141700 legacy=0x7fca28151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280b9ef0 con 0x7fca28071610 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fca20001a00 con 0x7fca28071610 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca27fff640 1 --2- 172.21.15.27:0/1835982141 >> v2:172.21.15.124:3300/0 conn(0x7fca28070010 0x7fca28070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 >> v1:172.21.15.27:6789/0 conn(0x7fca28071610 legacy=0x7fca28147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca08003980 0x7fca08003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca080047d0 0x7fca08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca280ba1d0 con 0x7fca08005190 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0800c0e0 con 0x7fca080047d0 2024-01-24T14:01:05.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0800e4b0 con 0x7fca08003980 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca277fe640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca080047d0 0x7fca08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 -- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca08003980 msgr2=0x7fca08003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca27fff640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca08003980 0x7fca08003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca08003980 0x7fca08003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 -- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca080047d0 msgr2=0x7fca08004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca080047d0 0x7fca08004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca2cac8640 1 -- 172.21.15.27:0/1835982141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08003530 con 0x7fca08005190 2024-01-24T14:01:05.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.522+0000 7fca277fe640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca080047d0 0x7fca08004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:05.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2cac8640 1 -- 172.21.15.27:0/1835982141 reap_dead start 2024-01-24T14:01:05.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2cac8640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca0800b990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fca10001780 tx=0x7fca1001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5431e636df3c0ddc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100050d0 con 0x7fca08005190 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100a7050 con 0x7fca08005190 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca26ffd640 1 -- 172.21.15.27:0/1835982141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10005490 con 0x7fca08005190 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 msgr2=0x7fca0800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca0800b990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fca10001780 tx=0x7fca1001c400 comp rx=0 tx=0).stop 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- 172.21.15.27:0/1835982141 shutdown_connections 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 --2- 172.21.15.27:0/1835982141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca0800b990 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- 172.21.15.27:0/1835982141 >> 172.21.15.27:0/1835982141 conn(0x7fca2806ae30 msgr2=0x7fca2806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- 172.21.15.27:0/1835982141 shutdown_connections 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- 172.21.15.27:0/1835982141 wait complete. 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 Processor -- start 2024-01-24T14:01:05.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- start start 2024-01-24T14:01:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca28144c80 0x7fca281db080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 0x7fca2813a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2813ded0 con 0x7fca08005190 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca28143740 con 0x7fca281426c0 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2e52b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca28144840 con 0x7fca28144c80 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48728/0 (socket says 172.21.15.27:48728) 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 -- 172.21.15.27:0/3566970329 learned_addr learned my addr 172.21.15.27:0/3566970329 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca277fe640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca28144c80 0x7fca281db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2cac8640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 0x7fca2813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 -- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca28144c80 msgr2=0x7fca281db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca28144c80 0x7fca281db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 -- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 msgr2=0x7fca2813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 0x7fca2813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca27fff640 1 -- 172.21.15.27:0/3566970329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28144560 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.526+0000 7fca2cac8640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 0x7fca2813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca27fff640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e560 tx=0x7fca1800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18013610 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca18013770 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca28141ec0 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18013b20 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca280bddc0 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2804e000 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca18013c80 con 0x7fca08005190 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca18082dc0 con 0x7fca08005190 2024-01-24T14:01:05.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca277fe640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.530+0000 7fca277fe640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 0x7fca0c067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fca281dc190 tx=0x7fca20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.534+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fca18050790 con 0x7fca08005190 2024-01-24T14:01:05.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.686+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca280ba980 con 0x7fca08005190 2024-01-24T14:01:05.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca24ff9640 1 -- 172.21.15.27:0/3566970329 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fca18053db0 con 0x7fca08005190 2024-01-24T14:01:05.690 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:05.691 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:53.778203+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T14:01:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 msgr2=0x7fca0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 0x7fca0c067f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fca281dc190 tx=0x7fca20009040 comp rx=0 tx=0).stop 2024-01-24T14:01:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 msgr2=0x7fca2813d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fca1800e560 tx=0x7fca1800ea20 comp rx=0 tx=0).stop 2024-01-24T14:01:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 shutdown_connections 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fca281426c0 0x7fca2813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fca28144c80 0x7fca281db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 --2- 172.21.15.27:0/3566970329 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca08005190 0x7fca2813d990 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 >> 172.21.15.27:0/3566970329 conn(0x7fca2806ae30 msgr2=0x7fca28140090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 shutdown_connections 2024-01-24T14:01:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.690+0000 7fca2e52b640 1 -- 172.21.15.27:0/3566970329 wait complete. 2024-01-24T14:01:05.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:51.275830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:51.757229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T14:01:05.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T14:01:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.826+0000 7f4104d0d640 1 Processor -- start 2024-01-24T14:01:05.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.826+0000 7f4104d0d640 1 -- start start 2024-01-24T14:01:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f4104d0d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 0x7f41000b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f4104d0d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41000b3dd0 0x7f4100151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f4104d0d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410006fc40 con 0x7f4100147640 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f4104d0d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41000706d0 con 0x7f41000b3dd0 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f4104d0d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410006ff20 con 0x7f41000b9b50 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 0x7f41000b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fed9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41000b3dd0 0x7f4100151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fdd9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4100147640 0x7f41001414f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:43298/0 (socket says 172.21.15.27:43298) 2024-01-24T14:01:05.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fdd9b640 1 -- 172.21.15.27:0/3758424961 learned_addr learned my addr 172.21.15.27:0/3758424961 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fd59a640 1 -- 172.21.15.27:0/3758424961 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177137576 0 0) 0x7f410006fc40 con 0x7f4100147640 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fd59a640 1 -- 172.21.15.27:0/3758424961 --> v1:172.21.15.124:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e8003530 con 0x7f4100147640 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 -- 172.21.15.27:0/3758424961 >> v2:172.21.15.124:3300/0 conn(0x7f41000b3dd0 msgr2=0x7f4100151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 --2- 172.21.15.27:0/3758424961 >> v2:172.21.15.124:3300/0 conn(0x7f41000b3dd0 0x7f4100151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 -- 172.21.15.27:0/3758424961 >> v1:172.21.15.124:6789/0 conn(0x7f4100147640 legacy=0x7f41001414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 -- 172.21.15.27:0/3758424961 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4100070200 con 0x7f41000b9b50 2024-01-24T14:01:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fe59c640 1 --2- 172.21.15.27:0/3758424961 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 0x7f41000b81b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009d90 tx=0x7f40f001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2ff31b5945b4d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.830+0000 7f40fd59a640 1 -- 172.21.15.27:0/3758424961 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00a5900 con 0x7f41000b9b50 2024-01-24T14:01:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fd59a640 1 -- 172.21.15.27:0/3758424961 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f00a5a60 con 0x7f41000b9b50 2024-01-24T14:01:05.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fd59a640 1 -- 172.21.15.27:0/3758424961 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00a5dd0 con 0x7f41000b9b50 2024-01-24T14:01:05.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/3758424961 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 msgr2=0x7f41000b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- 172.21.15.27:0/3758424961 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 0x7f41000b81b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009d90 tx=0x7f40f001c950 comp rx=0 tx=0).stop 2024-01-24T14:01:05.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/3758424961 shutdown_connections 2024-01-24T14:01:05.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- 172.21.15.27:0/3758424961 >> v2:172.21.15.124:3300/0 conn(0x7f41000b3dd0 0x7f4100151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- 172.21.15.27:0/3758424961 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b9b50 0x7f41000b81b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/3758424961 >> 172.21.15.27:0/3758424961 conn(0x7f41000bcf70 msgr2=0x7f41000bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/3758424961 shutdown_connections 2024-01-24T14:01:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/3758424961 wait complete. 2024-01-24T14:01:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 Processor -- start 2024-01-24T14:01:05.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- start start 2024-01-24T14:01:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b3dd0 0x7f4100139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41001e38d0 0x7f4100137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41000bbf10 con 0x7f41000b9b50 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4100139650 con 0x7f41001e38d0 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41001e2c20 con 0x7f41000b3dd0 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48730/0 (socket says 172.21.15.27:48730) 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 -- 172.21.15.27:0/2819695286 learned_addr learned my addr 172.21.15.27:0/2819695286 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fed9d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41001e38d0 0x7f4100137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fe59c640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b3dd0 0x7f4100139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 -- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b3dd0 msgr2=0x7f4100139110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b3dd0 0x7f4100139110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 -- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41001e38d0 msgr2=0x7f4100137840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41001e38d0 0x7f4100137840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:05.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 -- 172.21.15.27:0/2819695286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009a70 con 0x7f41000b9b50 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40fdd9b640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c3f0 tx=0x7f40f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4005cf0 con 0x7f41000b9b50 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41001e2f00 con 0x7f41000b9b50 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f4005e50 con 0x7f41000b9b50 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f40072f0 con 0x7f41000b9b50 2024-01-24T14:01:05.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.834+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41000bb620 con 0x7f41000b9b50 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41001e3090 con 0x7f41000b9b50 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40f4007450 con 0x7f41000b9b50 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f40eeffd640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 0x7f40e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40f4082b90 con 0x7f41000b9b50 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f40fe59c640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 0x7f40e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.838+0000 7f40fe59c640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 0x7f40e0067f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f40f00af000 tx=0x7f40f00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.842+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f40f40505e0 con 0x7f41000b9b50 2024-01-24T14:01:05.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.994+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41000b8670 con 0x7f41000b9b50 2024-01-24T14:01:05.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.994+0000 7f40eeffd640 1 -- 172.21.15.27:0/2819695286 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40f4017020 con 0x7f41000b9b50 2024-01-24T14:01:05.998 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 msgr2=0x7f40e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 0x7f40e0067f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f40f00af000 tx=0x7f40f00a7070 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 msgr2=0x7f41001e3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f40f400c3f0 tx=0x7f40f400c8b0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 shutdown_connections 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f40e0065a90 0x7f40e0067f50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41001e38d0 0x7f4100137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41000b9b50 0x7f41001e3390 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 --2- 172.21.15.27:0/2819695286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41000b3dd0 0x7f4100139110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 >> 172.21.15.27:0/2819695286 conn(0x7f41000bcf70 msgr2=0x7f4100146a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 shutdown_connections 2024-01-24T14:01:06.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:05.998+0000 7f4104d0d640 1 -- 172.21.15.27:0/2819695286 wait complete. 2024-01-24T14:01:06.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T14:01:06.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 Processor -- start 2024-01-24T14:01:06.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 -- start start 2024-01-24T14:01:06.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f420c0b44a0 0x7f420c1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c06e220 con 0x7f420c0b5060 2024-01-24T14:01:06.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0ba850 con 0x7f420c0a0c90 2024-01-24T14:01:06.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f421092f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c06df40 con 0x7f420c0b44a0 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f420c0b44a0 0x7f420c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f420c0b44a0 0x7f420c1427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48740/0 (socket says 172.21.15.27:48740) 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f4209d9b640 1 --1- 172.21.15.27:0/2815319943 >> v1:172.21.15.27:6789/0 conn(0x7f420c0b5060 0x7f420c148f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40954/0 (socket says 172.21.15.27:40954) 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 -- 172.21.15.27:0/2815319943 learned_addr learned my addr 172.21.15.27:0/2815319943 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 -- 172.21.15.27:0/2815319943 >> v1:172.21.15.124:6789/0 conn(0x7f420c0a0c90 legacy=0x7f420c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 -- 172.21.15.27:0/2815319943 >> v1:172.21.15.27:6789/0 conn(0x7f420c0b5060 legacy=0x7f420c148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 -- 172.21.15.27:0/2815319943 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c148a00 con 0x7f420c0b44a0 2024-01-24T14:01:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420a59c640 1 --2- 172.21.15.27:0/2815319943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c1427e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0098a0 tx=0x7f41fc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a84d179a1975eb7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420959a640 1 -- 172.21.15.27:0/2815319943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0ab5f0 con 0x7f420c0b44a0 2024-01-24T14:01:06.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420959a640 1 -- 172.21.15.27:0/2815319943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc0ab750 con 0x7f420c0b44a0 2024-01-24T14:01:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.130+0000 7f420959a640 1 -- 172.21.15.27:0/2815319943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0abae0 con 0x7f420c0b44a0 2024-01-24T14:01:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2815319943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 msgr2=0x7f420c1427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 --2- 172.21.15.27:0/2815319943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c1427e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0098a0 tx=0x7f41fc01c4e0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2815319943 shutdown_connections 2024-01-24T14:01:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 --2- 172.21.15.27:0/2815319943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c1427e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2815319943 >> 172.21.15.27:0/2815319943 conn(0x7f420c0babc0 msgr2=0x7f420c0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2815319943 shutdown_connections 2024-01-24T14:01:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2815319943 wait complete. 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 Processor -- start 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- start start 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f420c0a0c90 0x7f420c0a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f420c0b5060 0x7f420c138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0a31e0 con 0x7f420c0b44a0 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1e5510 con 0x7f420c0b5060 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c13fd20 con 0x7f420c0a0c90 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48754/0 (socket says 172.21.15.27:48754) 2024-01-24T14:01:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 -- 172.21.15.27:0/2365253394 learned_addr learned my addr 172.21.15.27:0/2365253394 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f420ad9d640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f420c0b5060 0x7f420c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 -- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f420c0a0c90 msgr2=0x7f420c0a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f420c0a0c90 0x7f420c0a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 -- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f420c0b5060 msgr2=0x7f420c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f420c0b5060 0x7f420c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 -- 172.21.15.27:0/2365253394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0094d0 con 0x7f420c0b44a0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f4209d9b640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f420000c390 tx=0x7f420000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000074e0 con 0x7f420c0b44a0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200007640 con 0x7f420c0b44a0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200004a10 con 0x7f420c0b44a0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c1e4750 con 0x7f420c0b44a0 2024-01-24T14:01:06.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c1e4d10 con 0x7f420c0b44a0 2024-01-24T14:01:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.134+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c04e000 con 0x7f420c0b44a0 2024-01-24T14:01:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.138+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4200004b70 con 0x7f420c0b44a0 2024-01-24T14:01:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.138+0000 7f41faffd640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 0x7f41ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.138+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4200082b10 con 0x7f420c0b44a0 2024-01-24T14:01:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.138+0000 7f420a59c640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 0x7f41ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.138+0000 7f420a59c640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 0x7f41ec067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0af000 tx=0x7f41fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.142+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4200050560 con 0x7f420c0b44a0 2024-01-24T14:01:06.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f420c0b8570 con 0x7f420c0b44a0 2024-01-24T14:01:06.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f41faffd640 1 -- 172.21.15.27:0/2365253394 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4200053b80 con 0x7f420c0b44a0 2024-01-24T14:01:06.294 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T14:01:06.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 msgr2=0x7f41ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 0x7f41ec067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0af000 tx=0x7f41fc008040 comp rx=0 tx=0).stop 2024-01-24T14:01:06.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 msgr2=0x7f420c13f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f420000c390 tx=0x7f420000c850 comp rx=0 tx=0).stop 2024-01-24T14:01:06.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 shutdown_connections 2024-01-24T14:01:06.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41ec065a60 0x7f41ec067f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f420c0b5060 0x7f420c138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f420c0b44a0 0x7f420c13f330 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 --2- 172.21.15.27:0/2365253394 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f420c0a0c90 0x7f420c0a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 >> 172.21.15.27:0/2365253394 conn(0x7f420c0babc0 msgr2=0x7f420c0b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 shutdown_connections 2024-01-24T14:01:06.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.294+0000 7f421092f640 1 -- 172.21.15.27:0/2365253394 wait complete. 2024-01-24T14:01:06.312 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.426+0000 7fbc57a0d640 1 Processor -- start 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.426+0000 7fbc57a0d640 1 -- start start 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc500b44a0 0x7fbc501427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b5060 0x7fbc50148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5006e220 con 0x7fbc500a0c90 2024-01-24T14:01:06.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc500ba850 con 0x7fbc500b44a0 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5006df40 con 0x7fbc500b5060 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc500b44a0 0x7fbc501427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbc500b44a0 0x7fbc501427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48764/0 (socket says 172.21.15.27:48764) 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 -- 172.21.15.27:0/2677166993 learned_addr learned my addr 172.21.15.27:0/2677166993 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc54fa8640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b5060 0x7fbc50148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 -- 172.21.15.27:0/2677166993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b5060 msgr2=0x7fbc50148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:06.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b5060 0x7fbc50148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 -- 172.21.15.27:0/2677166993 >> v1:172.21.15.124:6789/0 conn(0x7fbc500a0c90 legacy=0x7fbc5014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:06.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 -- 172.21.15.27:0/2677166993 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50148a00 con 0x7fbc500b44a0 2024-01-24T14:01:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc557a9640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500b44a0 0x7fbc501427e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009870 tx=0x7fbc4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdd044fd11a8b29 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc47fff640 1 -- 172.21.15.27:0/2677166993 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400ac630 con 0x7fbc500b44a0 2024-01-24T14:01:06.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc47fff640 1 -- 172.21.15.27:0/2677166993 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400ac790 con 0x7fbc500b44a0 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc47fff640 1 -- 172.21.15.27:0/2677166993 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400acb20 con 0x7fbc500b44a0 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- 172.21.15.27:0/2677166993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500b44a0 msgr2=0x7fbc501427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500b44a0 0x7fbc501427e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009870 tx=0x7fbc4001c500 comp rx=0 tx=0).stop 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- 172.21.15.27:0/2677166993 shutdown_connections 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b5060 0x7fbc50148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/2677166993 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500b44a0 0x7fbc501427e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.430+0000 7fbc57a0d640 1 -- 172.21.15.27:0/2677166993 >> 172.21.15.27:0/2677166993 conn(0x7fbc500babc0 msgr2=0x7fbc500bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- 172.21.15.27:0/2677166993 shutdown_connections 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- 172.21.15.27:0/2677166993 wait complete. 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 Processor -- start 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- start start 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b44a0 0x7fbc500a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 0x7fbc5006ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50152fa0 con 0x7fbc500a0c90 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500a28c0 con 0x7fbc500b5060 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500bdfb0 con 0x7fbc500b44a0 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48766/0 (socket says 172.21.15.27:48766) 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 -- 172.21.15.27:0/1631271621 learned_addr learned my addr 172.21.15.27:0/1631271621 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc55faa640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 0x7fbc5006ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 -- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b44a0 msgr2=0x7fbc500a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b44a0 0x7fbc500a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 -- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 msgr2=0x7fbc5006ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 0x7fbc5006ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 -- 172.21.15.27:0/1631271621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400094d0 con 0x7fbc500a0c90 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc55faa640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 0x7fbc5006ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc557a9640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001abb0 tx=0x7fbc4001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b7830 con 0x7fbc500a0c90 2024-01-24T14:01:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400b7990 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc50149870 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc500a24a0 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400b7d40 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.434+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc30005260 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.438+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc400b3040 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.438+0000 7fbc45ffb640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 0x7fbc34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.438+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc4011d610 con 0x7fbc500a0c90 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.438+0000 7fbc54fa8640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 0x7fbc34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.438+0000 7fbc54fa8640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 0x7fbc34067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc5013fc00 tx=0x7fbc4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.446+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbc400eb100 con 0x7fbc500a0c90 2024-01-24T14:01:06.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.594+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc30005a90 con 0x7fbc500a0c90 2024-01-24T14:01:06.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.594+0000 7fbc45ffb640 1 -- 172.21.15.27:0/1631271621 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc400ac5f0 con 0x7fbc500a0c90 2024-01-24T14:01:06.599 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T14:01:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 msgr2=0x7fbc34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 0x7fbc34067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbc5013fc00 tx=0x7fbc4c008040 comp rx=0 tx=0).stop 2024-01-24T14:01:06.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 msgr2=0x7fbc50152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbc4001abb0 tx=0x7fbc4001ad40 comp rx=0 tx=0).stop 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 shutdown_connections 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbc34065a60 0x7fbc34067f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbc500b5060 0x7fbc5006ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbc500b44a0 0x7fbc500a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 --2- 172.21.15.27:0/1631271621 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbc500a0c90 0x7fbc50152a60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 >> 172.21.15.27:0/1631271621 conn(0x7fbc500babc0 msgr2=0x7fbc500b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 shutdown_connections 2024-01-24T14:01:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.598+0000 7fbc57a0d640 1 -- 172.21.15.27:0/1631271621 wait complete. 2024-01-24T14:01:06.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-24T14:01:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.730+0000 7fcf884d4640 1 Processor -- start 2024-01-24T14:01:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.730+0000 7fcf884d4640 1 -- start start 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf884d4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf8006a840 0x7fcf80070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf884d4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf8014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf884d4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800711f0 con 0x7fcf8014b530 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf884d4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800720e0 con 0x7fcf8006a840 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf884d4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8014b9c0 con 0x7fcf8006ac20 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf8006a840 0x7fcf80070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86a71640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf8014b530 0x7fcf800b8050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40968/0 (socket says 172.21.15.27:40968) 2024-01-24T14:01:06.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86a71640 1 -- 172.21.15.27:0/2894770309 learned_addr learned my addr 172.21.15.27:0/2894770309 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf85a6f640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf8014aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 -- 172.21.15.27:0/2894770309 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 msgr2=0x7fcf8014aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf8526e640 1 -- 172.21.15.27:0/2894770309 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734063254 0 0) 0x7fcf78001120 con 0x7fcf8014b530 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf8014aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 -- 172.21.15.27:0/2894770309 >> v1:172.21.15.27:6789/0 conn(0x7fcf8014b530 legacy=0x7fcf800b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 -- 172.21.15.27:0/2894770309 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80071670 con 0x7fcf8006a840 2024-01-24T14:01:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf85a6f640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf8014aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf86270640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf80070cb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009d90 tx=0x7fcf7c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0ad9471252d506 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf8526e640 1 -- 172.21.15.27:0/2894770309 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0a57b0 con 0x7fcf8006a840 2024-01-24T14:01:06.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf8526e640 1 -- 172.21.15.27:0/2894770309 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0a5910 con 0x7fcf8006a840 2024-01-24T14:01:06.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.734+0000 7fcf8526e640 1 -- 172.21.15.27:0/2894770309 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0a5ca0 con 0x7fcf8006a840 2024-01-24T14:01:06.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/2894770309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 msgr2=0x7fcf80070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf80070cb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009d90 tx=0x7fcf7c01c8c0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/2894770309 shutdown_connections 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf8014aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- 172.21.15.27:0/2894770309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf80070cb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/2894770309 >> 172.21.15.27:0/2894770309 conn(0x7fcf80069d20 msgr2=0x7fcf8006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/2894770309 shutdown_connections 2024-01-24T14:01:06.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/2894770309 wait complete. 2024-01-24T14:01:06.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 Processor -- start 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- start start 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf80152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf8014b530 0x7fcf80150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800bbc90 con 0x7fcf8006a840 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b6ce0 con 0x7fcf8014b530 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b63b0 con 0x7fcf8006ac20 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48782/0 (socket says 172.21.15.27:48782) 2024-01-24T14:01:06.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 -- 172.21.15.27:0/1457026988 learned_addr learned my addr 172.21.15.27:0/1457026988 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf85a6f640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf80152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 -- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 msgr2=0x7fcf80152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86a71640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf8014b530 0x7fcf80150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf80152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 -- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf8014b530 msgr2=0x7fcf80150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf8014b530 0x7fcf80150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 -- 172.21.15.27:0/1457026988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009a70 con 0x7fcf8006a840 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf86270640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c01a4f0 tx=0x7fcf7c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0ad850 con 0x7fcf8006a840 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0ad9b0 con 0x7fcf8006a840 2024-01-24T14:01:06.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf800b6690 con 0x7fcf8006a840 2024-01-24T14:01:06.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0add40 con 0x7fcf8006a840 2024-01-24T14:01:06.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf80152660 con 0x7fcf8006a840 2024-01-24T14:01:06.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.738+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8004e000 con 0x7fcf8006a840 2024-01-24T14:01:06.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.742+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf7c0b4050 con 0x7fcf8006a840 2024-01-24T14:01:06.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.742+0000 7fcf76ffd640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 0x7fcf64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:06.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.742+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf7c11e320 con 0x7fcf8006a840 2024-01-24T14:01:06.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.742+0000 7fcf85a6f640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 0x7fcf64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:06.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.742+0000 7fcf85a6f640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 0x7fcf64067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcf70006fd0 tx=0x7fcf70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:06.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.746+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fcf7c0ebce0 con 0x7fcf8006a840 2024-01-24T14:01:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcf800b8510 con 0x7fcf8006a840 2024-01-24T14:01:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf76ffd640 1 -- 172.21.15.27:0/1457026988 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcf7c0ef300 con 0x7fcf8006a840 2024-01-24T14:01:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-24T14:01:06.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 msgr2=0x7fcf64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 0x7fcf64067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcf70006fd0 tx=0x7fcf70008040 comp rx=0 tx=0).stop 2024-01-24T14:01:06.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 msgr2=0x7fcf800bb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:06.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c01a4f0 tx=0x7fcf7c019660 comp rx=0 tx=0).stop 2024-01-24T14:01:06.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 shutdown_connections 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fcf64065a60 0x7fcf64067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fcf8014b530 0x7fcf80150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fcf8006ac20 0x7fcf80152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 --2- 172.21.15.27:0/1457026988 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf8006a840 0x7fcf800bb750 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 >> 172.21.15.27:0/1457026988 conn(0x7fcf80069d20 msgr2=0x7fcf800b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.914+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 shutdown_connections 2024-01-24T14:01:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:06.918+0000 7fcf884d4640 1 -- 172.21.15.27:0/1457026988 wait complete. 2024-01-24T14:01:06.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-24T14:01:06.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:06.933 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-24T14:01:06.964 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-01-24T14:01:06.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:06.964 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-24T14:01:07.034 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T14:01:07.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 Processor -- start 2024-01-24T14:01:07.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 -- start start 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9ea0144fc0 0x7f9ea0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea006c190 con 0x7f9ea014b4b0 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea006cd10 con 0x7f9ea00b8f90 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea6810640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea01453a0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea4dad640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9ea014b4b0 0x7f9ea0155460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40980/0 (socket says 172.21.15.27:40980) 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9ea4dad640 1 -- 172.21.15.27:0/2670275467 learned_addr learned my addr 172.21.15.27:0/2670275467 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2670275467 >> v2:172.21.15.27:3300/0 conn(0x7f9ea0144fc0 0x7f9ea0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9effd640 1 -- 172.21.15.27:0/2670275467 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916080212 0 0) 0x7f9ea006c190 con 0x7f9ea014b4b0 2024-01-24T14:01:07.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9effd640 1 -- 172.21.15.27:0/2670275467 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e8c003530 con 0x7f9ea014b4b0 2024-01-24T14:01:07.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9ffff640 1 -- 172.21.15.27:0/2670275467 >> v1:172.21.15.124:6789/0 conn(0x7f9ea00b8f90 legacy=0x7f9ea014ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9ffff640 1 -- 172.21.15.27:0/2670275467 >> v1:172.21.15.27:6789/0 conn(0x7f9ea014b4b0 legacy=0x7f9ea0155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.154+0000 7f9e9ffff640 1 -- 172.21.15.27:0/2670275467 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea006ee20 con 0x7f9ea0144fc0 2024-01-24T14:01:07.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2670275467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea0070f00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097c0 tx=0x7f9e9801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51619b9578d5d3ca server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9effd640 1 -- 172.21.15.27:0/2670275467 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980ab650 con 0x7f9ea0144fc0 2024-01-24T14:01:07.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9effd640 1 -- 172.21.15.27:0/2670275467 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e980ab7b0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9effd640 1 -- 172.21.15.27:0/2670275467 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980abb40 con 0x7f9ea0144fc0 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2670275467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 msgr2=0x7f9ea0070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2670275467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea0070f00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097c0 tx=0x7f9e9801c450 comp rx=0 tx=0).stop 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2670275467 shutdown_connections 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2670275467 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea0070f00 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2670275467 >> 172.21.15.27:0/2670275467 conn(0x7f9ea00be150 msgr2=0x7f9ea00be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2670275467 shutdown_connections 2024-01-24T14:01:07.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2670275467 wait complete. 2024-01-24T14:01:07.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 Processor -- start 2024-01-24T14:01:07.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- start start 2024-01-24T14:01:07.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 0x7f9ea01e6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 0x7f9ea009eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00a0d90 con 0x7f9ea0144fc0 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea009e700 con 0x7f9ea014b4b0 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea009f080 con 0x7f9ea00b8f90 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48798/0 (socket says 172.21.15.27:48798) 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 -- 172.21.15.27:0/2176589154 learned_addr learned my addr 172.21.15.27:0/2176589154 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea4dad640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 0x7f9ea009eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 0x7f9ea01e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 -- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 msgr2=0x7f9ea01e6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 0x7f9ea01e6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 -- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 msgr2=0x7f9ea009eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 0x7f9ea009eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 -- 172.21.15.27:0/2176589154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009420 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea4dad640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 0x7f9ea009eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 0x7f9ea01e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9f7fe640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c7d0 tx=0x7f9e9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003b80 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90003ce0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea00a0060 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000aa30 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.158+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea00a07d0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea004e000 con 0x7f9ea0144fc0 2024-01-24T14:01:07.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e9000ab90 con 0x7f9ea0144fc0 2024-01-24T14:01:07.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9e9cff9640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 0x7f9e80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e900839c0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 0x7f9e80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.162+0000 7f9e9ffff640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 0x7f9e80067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.166+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f9e900514f0 con 0x7f9ea0144fc0 2024-01-24T14:01:07.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ea006e940 con 0x7f9ea0144fc0 2024-01-24T14:01:07.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9e9cff9640 1 -- 172.21.15.27:0/2176589154 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7f9e90054b10 con 0x7f9ea0144fc0 2024-01-24T14:01:07.351 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:07.352 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T14:01:07.352 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 msgr2=0x7f9e80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 0x7f9e80067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 msgr2=0x7f9ea009f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c7d0 tx=0x7f9e9000cc90 comp rx=0 tx=0).stop 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 shutdown_connections 2024-01-24T14:01:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f9e80065a60 0x7f9e80067f20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f9ea014b4b0 0x7f9ea009eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ea0144fc0 0x7f9ea009f970 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 --2- 172.21.15.27:0/2176589154 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f9ea00b8f90 0x7f9ea01e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 >> 172.21.15.27:0/2176589154 conn(0x7f9ea00be150 msgr2=0x7f9ea00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 shutdown_connections 2024-01-24T14:01:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.350+0000 7f9ea6810640 1 -- 172.21.15.27:0/2176589154 wait complete. 2024-01-24T14:01:07.369 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T14:01:07.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.478+0000 7f439944d640 1 Processor -- start 2024-01-24T14:01:07.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.478+0000 7f439944d640 1 -- start start 2024-01-24T14:01:07.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f439944d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f439406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f439944d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f43940b81c0 0x7f43940b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f439944d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940702c0 con 0x7f439414a9e0 2024-01-24T14:01:07.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f439944d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43940b8650 con 0x7f43940b81c0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f439944d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439406ff50 con 0x7f4394069d20 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f43937fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f439414a9e0 0x7f439414dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:40990/0 (socket says 172.21.15.27:40990) 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f43937fe640 1 -- 172.21.15.27:0/149179758 learned_addr learned my addr 172.21.15.27:0/149179758 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f43927fc640 1 --2- 172.21.15.27:0/149179758 >> v2:172.21.15.124:3300/0 conn(0x7f43940b81c0 0x7f43940b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f439406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829285328 0 0) 0x7f43940702c0 con 0x7f439414a9e0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f437c003530 con 0x7f439414a9e0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686303944 0 0) 0x7f437c003530 con 0x7f439414a9e0 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 msgr2=0x7f439406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f439406a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 >> v2:172.21.15.124:3300/0 conn(0x7f43940b81c0 msgr2=0x7f43940b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 --2- 172.21.15.27:0/149179758 >> v2:172.21.15.124:3300/0 conn(0x7f43940b81c0 0x7f43940b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394145050 con 0x7f439414a9e0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f438c001680 con 0x7f439414a9e0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 >> v1:172.21.15.27:6789/0 conn(0x7f439414a9e0 legacy=0x7f439414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f437c003980 0x7f437c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f437c0047d0 0x7f437c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f437c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940b8650 con 0x7f437c003980 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439406ff50 con 0x7f437c0047d0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c00b990 con 0x7f4394069d20 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f437c003980 0x7f437c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f43937fe640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f437c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f43927fc640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f437c0047d0 0x7f437c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 -- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 msgr2=0x7f437c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4394069d20 0x7f437c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 -- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f437c0047d0 msgr2=0x7f437c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f437c0047d0 0x7f437c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 -- 172.21.15.27:0/149179758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c003530 con 0x7f437c003980 2024-01-24T14:01:07.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4392ffd640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f437c003980 0x7f437c003da0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4384009fc0 tx=0x7f438401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c5745ebfa1b07a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43840a5a80 con 0x7f437c003980 2024-01-24T14:01:07.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400f040 con 0x7f437c003980 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.482+0000 7f4391ffb640 1 -- 172.21.15.27:0/149179758 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43840a5e20 con 0x7f437c003980 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/149179758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f437c003980 msgr2=0x7f437c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 --2- 172.21.15.27:0/149179758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f437c003980 0x7f437c003da0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4384009fc0 tx=0x7f438401cc60 comp rx=0 tx=0).stop 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43937fe640 1 -- 172.21.15.27:0/149179758 reap_dead start 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/149179758 shutdown_connections 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/149179758 >> 172.21.15.27:0/149179758 conn(0x7f439406ae30 msgr2=0x7f439406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/149179758 shutdown_connections 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/149179758 wait complete. 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 Processor -- start 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- start start 2024-01-24T14:01:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 0x7f43940b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 0x7f4394147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940b7190 con 0x7f4394148100 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394145850 con 0x7f43940b4310 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940b5de0 con 0x7f437c003980 2024-01-24T14:01:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48802/0 (socket says 172.21.15.27:48802) 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 -- 172.21.15.27:0/1282813199 learned_addr learned my addr 172.21.15.27:0/1282813199 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f4392ffd640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 0x7f43940b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43937fe640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 0x7f4394147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 -- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 msgr2=0x7f43940b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 0x7f43940b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 -- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 msgr2=0x7f4394147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 0x7f4394147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 -- 172.21.15.27:0/1282813199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43941452d0 con 0x7f4394148100 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43937fe640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 0x7f4394147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:07.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f4392ffd640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 0x7f43940b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f43927fc640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4388011690 tx=0x7f4388011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800f9c0 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438800fb20 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4394147ce0 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800fe90 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394146c10 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.486+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439404e000 con 0x7f4394148100 2024-01-24T14:01:07.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.490+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4388015460 con 0x7f4394148100 2024-01-24T14:01:07.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.490+0000 7f437b7fe640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 0x7f4380067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.490+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4388083540 con 0x7f4394148100 2024-01-24T14:01:07.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.490+0000 7f4392ffd640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 0x7f4380067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.490+0000 7f4392ffd640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 0x7f4380067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43840af000 tx=0x7f43840a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.498+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4388050f90 con 0x7f4394148100 2024-01-24T14:01:07.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.650+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43940b7fa0 con 0x7f4394148100 2024-01-24T14:01:07.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f437b7fe640 1 -- 172.21.15.27:0/1282813199 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f43880545b0 con 0x7f4394148100 2024-01-24T14:01:07.655 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:07.655 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:53.778203+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 msgr2=0x7f4380067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 0x7f4380067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43840af000 tx=0x7f43840a7040 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 msgr2=0x7f43941466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4388011690 tx=0x7f4388011b50 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 shutdown_connections 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4380065a90 0x7f4380067f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f43940b4310 0x7f4394147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4394148100 0x7f43941466d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 --2- 172.21.15.27:0/1282813199 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f437c003980 0x7f43940b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 >> 172.21.15.27:0/1282813199 conn(0x7f439406ae30 msgr2=0x7f4394143a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 shutdown_connections 2024-01-24T14:01:07.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.654+0000 7f439944d640 1 -- 172.21.15.27:0/1282813199 wait complete. 2024-01-24T14:01:07.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T12:43:59.705471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-24T12:44:51.275830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-24T12:44:51.757229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T14:01:07.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T14:01:07.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 Processor -- start 2024-01-24T14:01:07.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 -- start start 2024-01-24T14:01:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f41dc1429f0 0x7f41dc0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc070670 con 0x7f41dc071560 2024-01-24T14:01:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0b91a0 con 0x7f41dc0b3e20 2024-01-24T14:01:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41e1afb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0b7cf0 con 0x7f41dc1429f0 2024-01-24T14:01:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41dbfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f41dc071560 0x7f41dc1530c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41004/0 (socket says 172.21.15.27:41004) 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41dbfff640 1 -- 172.21.15.27:0/1216609146 learned_addr learned my addr 172.21.15.27:0/1216609146 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080533958 0 0) 0x7f41dc070670 con 0x7f41dc071560 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1216609146 >> v2:172.21.15.124:3300/0 conn(0x7f41dc1429f0 0x7f41dc0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c4003530 con 0x7f41dc071560 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3130113502 0 0) 0x7f41c4003530 con 0x7f41dc071560 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 >> v2:172.21.15.124:3300/0 conn(0x7f41dc1429f0 msgr2=0x7f41dc0b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 --2- 172.21.15.27:0/1216609146 >> v2:172.21.15.124:3300/0 conn(0x7f41dc1429f0 0x7f41dc0b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 >> v1:172.21.15.124:6789/0 conn(0x7f41dc0b3e20 legacy=0x7f41dc070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0b8b50 con 0x7f41dc071560 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f41d4001a00 con 0x7f41dc071560 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 >> v1:172.21.15.27:6789/0 conn(0x7f41dc071560 legacy=0x7f41dc1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 0x7f41c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41c40047d0 0x7f41c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4005190 0x7f41c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0b7cf0 con 0x7f41c4003980 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c400c0c0 con 0x7f41c40047d0 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c400c280 con 0x7f41c4005190 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 0x7f41c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41daffd640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41c40047d0 0x7f41c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41dbfff640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4005190 0x7f41c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 -- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4005190 msgr2=0x7f41c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4005190 0x7f41c400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 -- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41c40047d0 msgr2=0x7f41c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41c40047d0 0x7f41c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41db7fe640 1 -- 172.21.15.27:0/1216609146 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4003530 con 0x7f41c4003980 2024-01-24T14:01:07.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.790+0000 7f41dbfff640 1 -- 172.21.15.27:0/1216609146 reap_dead start 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 0x7f41c4003da0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ba30 tx=0x7f41cc01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c14ea1bb1da19ae server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a9680 con 0x7f41c4003980 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc0a97e0 con 0x7f41c4003980 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41da7fc640 1 -- 172.21.15.27:0/1216609146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a9b90 con 0x7f41c4003980 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 msgr2=0x7f41c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 0x7f41c4003da0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00ba30 tx=0x7f41cc01c6a0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- 172.21.15.27:0/1216609146 shutdown_connections 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1216609146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41c4003980 0x7f41c4003da0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- 172.21.15.27:0/1216609146 >> 172.21.15.27:0/1216609146 conn(0x7f41dc0bcf70 msgr2=0x7f41dc0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- 172.21.15.27:0/1216609146 shutdown_connections 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- 172.21.15.27:0/1216609146 wait complete. 2024-01-24T14:01:07.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 Processor -- start 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- start start 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4003980 0x7f41dc1de430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41dc136010 0x7f41dc136490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc1d1f30 con 0x7f41dc141d80 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc138d10 con 0x7f41dc136010 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41e1afb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc1402d0 con 0x7f41c4003980 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48814/0 (socket says 172.21.15.27:48814) 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 -- 172.21.15.27:0/1034954519 learned_addr learned my addr 172.21.15.27:0/1034954519 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41dbfff640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41dc136010 0x7f41dc136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4003980 0x7f41dc1de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 -- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4003980 msgr2=0x7f41dc1de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4003980 0x7f41dc1de430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 -- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41dc136010 msgr2=0x7f41dc136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41dc136010 0x7f41dc136490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.794+0000 7f41daffd640 1 -- 172.21.15.27:0/1034954519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc1d2c90 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41daffd640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e410 tx=0x7f41d000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00052e0 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0005440 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc142200 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0003820 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc13d0d0 con 0x7f41dc141d80 2024-01-24T14:01:07.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc04e000 con 0x7f41dc141d80 2024-01-24T14:01:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41d0003980 con 0x7f41dc141d80 2024-01-24T14:01:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 0x7f41c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41d0082870 con 0x7f41dc141d80 2024-01-24T14:01:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 0x7f41c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:07.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.798+0000 7f41db7fe640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 0x7f41c8067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0b0000 tx=0x7f41cc0ac040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:07.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.802+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f41d0050370 con 0x7f41dc141d80 2024-01-24T14:01:07.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.950+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41dc0702e0 con 0x7f41dc141d80 2024-01-24T14:01:07.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.950+0000 7f41c3fff640 1 -- 172.21.15.27:0/1034954519 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41d0019020 con 0x7f41dc141d80 2024-01-24T14:01:07.953 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 msgr2=0x7f41c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 0x7f41c8067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0b0000 tx=0x7f41cc0ac040 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 msgr2=0x7f41dc1387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e410 tx=0x7f41d000e8d0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 shutdown_connections 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f41c8065a60 0x7f41c8067f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f41dc136010 0x7f41dc136490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41dc141d80 0x7f41dc1387d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 --2- 172.21.15.27:0/1034954519 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f41c4003980 0x7f41dc1de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 >> 172.21.15.27:0/1034954519 conn(0x7f41dc0bcf70 msgr2=0x7f41dc06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:07.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 shutdown_connections 2024-01-24T14:01:07.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:07.954+0000 7f41e1afb640 1 -- 172.21.15.27:0/1034954519 wait complete. 2024-01-24T14:01:07.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-24T14:01:08.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 Processor -- start 2024-01-24T14:01:08.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 -- start start 2024-01-24T14:01:08.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b7c142d80 0x7f4b7c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c148a80 con 0x7f4b7c0b8540 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c0b3890 con 0x7f4b7c142d80 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b80a8b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0b3b70 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7ad9d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4b7c142d80 0x7f4b7c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:52082/0 (socket says 172.21.15.27:52082) 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b79d9b640 1 --1- >> v1:172.21.15.124:6789/0 conn(0x7f4b7c0b8540 0x7f4b7c148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:43346/0 (socket says 172.21.15.27:43346) 2024-01-24T14:01:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7a59c640 1 -- 172.21.15.27:0/3675111334 learned_addr learned my addr 172.21.15.27:0/3675111334 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:08.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7ad9d640 1 -- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 msgr2=0x7f4b7c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7ad9d640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7ad9d640 1 -- 172.21.15.27:0/3675111334 >> v1:172.21.15.124:6789/0 conn(0x7f4b7c0b8540 legacy=0x7f4b7c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7ad9d640 1 -- 172.21.15.27:0/3675111334 --> v2:172.21.15.124:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0b3e50 con 0x7f4b7c142d80 2024-01-24T14:01:08.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.090+0000 7f4b7a59c640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T14:01:08.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b7ad9d640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c1531b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009d90 tx=0x7f4b7401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d1b03875c9e0d3c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b7959a640 1 -- 172.21.15.27:0/3675111334 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c071930 con 0x7f4b7c142d80 2024-01-24T14:01:08.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b7959a640 1 -- 172.21.15.27:0/3675111334 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b740a5a30 con 0x7f4b7c142d80 2024-01-24T14:01:08.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b7959a640 1 -- 172.21.15.27:0/3675111334 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740a5dc0 con 0x7f4b7c142d80 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 msgr2=0x7f4b7c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c1531b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009d90 tx=0x7f4b7401c950 comp rx=0 tx=0).stop 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- 172.21.15.27:0/3675111334 shutdown_connections 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c1531b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/3675111334 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8df0 0x7f4b7c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- 172.21.15.27:0/3675111334 >> 172.21.15.27:0/3675111334 conn(0x7f4b7c06a120 msgr2=0x7f4b7c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- 172.21.15.27:0/3675111334 shutdown_connections 2024-01-24T14:01:08.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- 172.21.15.27:0/3675111334 wait complete. 2024-01-24T14:01:08.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 Processor -- start 2024-01-24T14:01:08.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- start start 2024-01-24T14:01:08.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8540 0x7f4b7c1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c136450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c13ddd0 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c13d4e0 con 0x7f4b7c142d80 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b80a8b640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c13d780 con 0x7f4b7c0b8540 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b79d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b79d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48820/0 (socket says 172.21.15.27:48820) 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.094+0000 7f4b79d9b640 1 -- 172.21.15.27:0/2782298160 learned_addr learned my addr 172.21.15.27:0/2782298160 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b7ad9d640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c136450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b7a59c640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8540 0x7f4b7c1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 -- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8540 msgr2=0x7f4b7c1376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8540 0x7f4b7c1376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 -- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 msgr2=0x7f4b7c136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c136450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 -- 172.21.15.27:0/2782298160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0094d0 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b79d9b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c420 tx=0x7f4b6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640074e0 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64007640 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b74009a70 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64004a30 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0ba960 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c13df40 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b64004b90 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 0x7f4b5c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b64082b70 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b7a59c640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 0x7f4b5c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.098+0000 7f4b7a59c640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 0x7f4b5c067f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009c70 tx=0x7f4b6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.102+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f4b640505c0 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.250+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b7c04e000 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.250+0000 7f4b72ffd640 1 -- 172.21.15.27:0/2782298160 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b64053be0 con 0x7f4b7c0b8df0 2024-01-24T14:01:08.253 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 msgr2=0x7f4b5c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 0x7f4b5c067f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009c70 tx=0x7f4b6c008040 comp rx=0 tx=0).stop 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 msgr2=0x7f4b7c13e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c420 tx=0x7f4b6400c8e0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 shutdown_connections 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4b5c065a90 0x7f4b5c067f50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4b7c142d80 0x7f4b7c136450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4b7c0b8df0 0x7f4b7c13e480 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 --2- 172.21.15.27:0/2782298160 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4b7c0b8540 0x7f4b7c1376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 >> 172.21.15.27:0/2782298160 conn(0x7f4b7c06a120 msgr2=0x7f4b7c0b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 shutdown_connections 2024-01-24T14:01:08.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.254+0000 7f4b80a8b640 1 -- 172.21.15.27:0/2782298160 wait complete. 2024-01-24T14:01:08.272 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-24T14:01:08.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 Processor -- start 2024-01-24T14:01:08.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 -- start start 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feca00b8240 0x7feca00ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b76c0 0x7feca014e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00b7e30 con 0x7feca014a910 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00bbd30 con 0x7feca00b8240 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7feca55e3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00ba680 con 0x7feca00b76c0 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feca00b8240 0x7feca00ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feca00b8240 0x7feca00ba140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48832/0 (socket says 172.21.15.27:48832) 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 -- 172.21.15.27:0/3153972456 learned_addr learned my addr 172.21.15.27:0/3153972456 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec97fff640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b76c0 0x7feca014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 -- 172.21.15.27:0/3153972456 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b76c0 msgr2=0x7feca014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b76c0 0x7feca014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 -- 172.21.15.27:0/3153972456 >> v1:172.21.15.124:6789/0 conn(0x7feca014a910 legacy=0x7feca0144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 -- 172.21.15.27:0/3153972456 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00b7b50 con 0x7feca00b8240 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9effd640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca00b8240 0x7feca00ba140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec9001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9e7dee1e449640 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9e7fc640 1 -- 172.21.15.27:0/3153972456 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900ac600 con 0x7feca00b8240 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9e7fc640 1 -- 172.21.15.27:0/3153972456 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900a8050 con 0x7feca00b8240 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.402+0000 7fec9e7fc640 1 -- 172.21.15.27:0/3153972456 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900ac980 con 0x7feca00b8240 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/3153972456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca00b8240 msgr2=0x7feca00ba140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca00b8240 0x7feca00ba140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fec90009870 tx=0x7fec9001c4b0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/3153972456 shutdown_connections 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b76c0 0x7feca014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- 172.21.15.27:0/3153972456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca00b8240 0x7feca00ba140 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/3153972456 >> 172.21.15.27:0/3153972456 conn(0x7feca00c0280 msgr2=0x7feca00c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/3153972456 shutdown_connections 2024-01-24T14:01:08.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/3153972456 wait complete. 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 Processor -- start 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- start start 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 0x7feca00bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 0x7feca01e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca01e5d70 con 0x7feca014a910 2024-01-24T14:01:08.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0139a10 con 0x7feca0138fc0 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca0139450 con 0x7feca00b8240 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48842/0 (socket says 172.21.15.27:48842) 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 -- 172.21.15.27:0/1166780042 learned_addr learned my addr 172.21.15.27:0/1166780042 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec9f7fe640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 0x7feca01e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec9effd640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 0x7feca00bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 -- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 msgr2=0x7feca00bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 0x7feca00bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 -- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 msgr2=0x7feca01e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 0x7feca01e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 -- 172.21.15.27:0/1166780042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900094d0 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec9f7fe640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 0x7feca01e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec9effd640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 0x7feca00bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec97fff640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d800 tx=0x7fec8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800b6c0 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800b820 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800bb90 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca0139730 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca014ba60 con 0x7feca014a910 2024-01-24T14:01:08.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.406+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca01e5ee0 con 0x7feca014a910 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.410+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec8800bcf0 con 0x7feca014a910 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.410+0000 7fec977fe640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 0x7fec80067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.410+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec88084090 con 0x7feca014a910 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.410+0000 7fec9effd640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 0x7fec80067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.410+0000 7fec9effd640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 0x7fec80067f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.414+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fec88051bc0 con 0x7feca014a910 2024-01-24T14:01:08.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.562+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feca004e000 con 0x7feca014a910 2024-01-24T14:01:08.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.562+0000 7fec977fe640 1 -- 172.21.15.27:0/1166780042 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec880551e0 con 0x7feca014a910 2024-01-24T14:01:08.565 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 msgr2=0x7fec80067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 0x7fec80067f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec90008040 comp rx=0 tx=0).stop 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 msgr2=0x7feca01e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d800 tx=0x7fec8800dcc0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 shutdown_connections 2024-01-24T14:01:08.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fec80065a90 0x7fec80067f50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feca0138fc0 0x7feca01e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca014a910 0x7feca01e6200 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 --2- 172.21.15.27:0/1166780042 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feca00b8240 0x7feca00bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 >> 172.21.15.27:0/1166780042 conn(0x7feca00c0280 msgr2=0x7feca00c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 shutdown_connections 2024-01-24T14:01:08.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.566+0000 7feca55e3640 1 -- 172.21.15.27:0/1166780042 wait complete. 2024-01-24T14:01:08.583 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T14:01:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.698+0000 7fea233bb640 1 Processor -- start 2024-01-24T14:01:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.698+0000 7fea233bb640 1 -- start start 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea233bb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fea1c0714f0 0x7fea1c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea233bb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c14e160 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea233bb640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c14f000 con 0x7fea1c06c5b0 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea233bb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c06cab0 con 0x7fea1c0714f0 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fea1c0b8ad0 0x7fea1c14e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41012/0 (socket says 172.21.15.27:41012) 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 -- 172.21.15.27:0/2244454678 learned_addr learned my addr 172.21.15.27:0/2244454678 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201947667 0 0) 0x7fea1c14e160 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea08003530 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea20956640 1 --2- 172.21.15.27:0/2244454678 >> v2:172.21.15.124:3300/0 conn(0x7fea1c0714f0 0x7fea1c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046153847 0 0) 0x7fea08003530 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 >> v2:172.21.15.124:3300/0 conn(0x7fea1c0714f0 msgr2=0x7fea1c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 --2- 172.21.15.27:0/2244454678 >> v2:172.21.15.124:3300/0 conn(0x7fea1c0714f0 0x7fea1c06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 >> v1:172.21.15.124:6789/0 conn(0x7fea1c06c5b0 legacy=0x7fea1c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c14e3d0 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fea10001680 con 0x7fea1c0b8ad0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 >> v1:172.21.15.27:6789/0 conn(0x7fea1c0b8ad0 legacy=0x7fea1c14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 0x7fea08003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea080047d0 0x7fea08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea08005190 0x7fea0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c06cab0 con 0x7fea080039d0 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0800c090 con 0x7fea08005190 2024-01-24T14:01:08.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0800c250 con 0x7fea080047d0 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 0x7fea08003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 -- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea080047d0 msgr2=0x7fea08004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea20956640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea080047d0 0x7fea08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21958640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea08005190 0x7fea0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea080047d0 0x7fea08004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 -- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea08005190 msgr2=0x7fea0800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea08005190 0x7fea0800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21157640 1 -- 172.21.15.27:0/2244454678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08003530 con 0x7fea080039d0 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21958640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea08005190 0x7fea0800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:08.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.702+0000 7fea21958640 1 -- 172.21.15.27:0/2244454678 reap_dead start 2024-01-24T14:01:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea21157640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 0x7fea08003df0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c110 tx=0x7fea1001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4755b98c7cbbd7e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10005ae0 con 0x7fea080039d0 2024-01-24T14:01:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10005c40 con 0x7fea080039d0 2024-01-24T14:01:08.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea0ffff640 1 -- 172.21.15.27:0/2244454678 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100a5860 con 0x7fea080039d0 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 msgr2=0x7fea08003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 0x7fea08003df0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c110 tx=0x7fea1001cb60 comp rx=0 tx=0).stop 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- 172.21.15.27:0/2244454678 shutdown_connections 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 --2- 172.21.15.27:0/2244454678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea080039d0 0x7fea08003df0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- 172.21.15.27:0/2244454678 >> 172.21.15.27:0/2244454678 conn(0x7fea1c0be150 msgr2=0x7fea1c0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- 172.21.15.27:0/2244454678 shutdown_connections 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- 172.21.15.27:0/2244454678 wait complete. 2024-01-24T14:01:08.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 Processor -- start 2024-01-24T14:01:08.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- start start 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea080039d0 0x7fea1c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea1c0b5b20 0x7fea1c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0b5fd0 con 0x7fea1c0b7420 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1e3dd0 con 0x7fea080039d0 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea233bb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1e4050 con 0x7fea1c0b5b20 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea20956640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea20956640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48868/0 (socket says 172.21.15.27:48868) 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.706+0000 7fea20956640 1 -- 172.21.15.27:0/2639999031 learned_addr learned my addr 172.21.15.27:0/2639999031 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea21157640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea080039d0 0x7fea1c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea21958640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea1c0b5b20 0x7fea1c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 -- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea1c0b5b20 msgr2=0x7fea1c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea1c0b5b20 0x7fea1c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 -- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea080039d0 msgr2=0x7fea1c0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea080039d0 0x7fea1c0b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 -- 172.21.15.27:0/2639999031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c1e4330 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea20956640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fea18010930 tx=0x7fea18010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180096b0 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800ec20 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1801c400 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c1e4610 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0a2c30 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c1e4850 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea1801c560 con 0x7fea1c0b7420 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 0x7fea00067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:08.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea18083610 con 0x7fea1c0b7420 2024-01-24T14:01:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea21157640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 0x7fea00067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.710+0000 7fea21157640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 0x7fea00067f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fea100ab000 tx=0x7fea100b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:08.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.714+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fea180511d0 con 0x7fea1c0b7420 2024-01-24T14:01:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea1c0b5220 con 0x7fea1c0b7420 2024-01-24T14:01:08.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea0dffb640 1 -- 172.21.15.27:0/2639999031 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7fea180547f0 con 0x7fea1c0b7420 2024-01-24T14:01:08.899 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T14:01:08.899 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T14:01:08.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 msgr2=0x7fea00067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 0x7fea00067f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fea100ab000 tx=0x7fea100b1040 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 msgr2=0x7fea1c0b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fea18010930 tx=0x7fea18010df0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 shutdown_connections 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fea00065a90 0x7fea00067f50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fea1c0b5b20 0x7fea1c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fea1c0b7420 0x7fea1c0b55e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 --2- 172.21.15.27:0/2639999031 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fea080039d0 0x7fea1c0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 >> 172.21.15.27:0/2639999031 conn(0x7fea1c0be150 msgr2=0x7fea1c0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 shutdown_connections 2024-01-24T14:01:08.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:08.898+0000 7fea233bb640 1 -- 172.21.15.27:0/2639999031 wait complete. 2024-01-24T14:01:08.916 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T14:01:09.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.042+0000 7f5b567d0640 1 Processor -- start 2024-01-24T14:01:09.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.042+0000 7f5b567d0640 1 -- start start 2024-01-24T14:01:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5b50069d20 0x7f5b5006a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f5b500b81c0 0x7f5b500b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500702c0 con 0x7f5b5014a9e0 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b500b8650 con 0x7f5b50069d20 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5006ff50 con 0x7f5b500b81c0 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5b50069d20 0x7f5b5006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5b50069d20 0x7f5b5006a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48874/0 (socket says 172.21.15.27:48874) 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3033536735 learned_addr learned my addr 172.21.15.27:0/3033536735 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3033536735 >> v2:172.21.15.124:3300/0 conn(0x7f5b500b81c0 msgr2=0x7f5b500b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 --2- 172.21.15.27:0/3033536735 >> v2:172.21.15.124:3300/0 conn(0x7f5b500b81c0 0x7f5b500b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3033536735 >> v1:172.21.15.124:6789/0 conn(0x7f5b5014a9e0 legacy=0x7f5b5014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3033536735 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b50145050 con 0x7f5b50069d20 2024-01-24T14:01:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4ffff640 1 --2- 172.21.15.27:0/3033536735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b5006a100 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b50071ae0 tx=0x7f5b4001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d984025d6d64c95 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4effd640 1 -- 172.21.15.27:0/3033536735 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400af400 con 0x7f5b50069d20 2024-01-24T14:01:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4effd640 1 -- 172.21.15.27:0/3033536735 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b400ab050 con 0x7f5b50069d20 2024-01-24T14:01:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b4effd640 1 -- 172.21.15.27:0/3033536735 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400af780 con 0x7f5b50069d20 2024-01-24T14:01:09.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- 172.21.15.27:0/3033536735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 msgr2=0x7f5b5006a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3033536735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b5006a100 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b50071ae0 tx=0x7f5b4001f180 comp rx=0 tx=0).stop 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- 172.21.15.27:0/3033536735 shutdown_connections 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3033536735 >> v2:172.21.15.124:3300/0 conn(0x7f5b500b81c0 0x7f5b500b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3033536735 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b5006a100 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.046+0000 7f5b567d0640 1 -- 172.21.15.27:0/3033536735 >> 172.21.15.27:0/3033536735 conn(0x7f5b5006ae30 msgr2=0x7f5b5006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- 172.21.15.27:0/3033536735 shutdown_connections 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- 172.21.15.27:0/3033536735 wait complete. 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 Processor -- start 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- start start 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 0x7f5b5014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 0x7f5b5013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5013abe0 con 0x7f5b50069d20 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5013a1f0 con 0x7f5b5014a9e0 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b501490a0 con 0x7f5b50148bf0 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48880/0 (socket says 172.21.15.27:48880) 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3760043885 learned_addr learned my addr 172.21.15.27:0/3760043885 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b54d6d640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 0x7f5b5013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4f7fe640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 0x7f5b5014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 msgr2=0x7f5b5013a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 0x7f5b5013a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 msgr2=0x7f5b5014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 0x7f5b5014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 -- 172.21.15.27:0/3760043885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009b30 con 0x7f5b50069d20 2024-01-24T14:01:09.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b54d6d640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 0x7f5b5013a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4f7fe640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 0x7f5b5014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4ffff640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b2040 tx=0x7f5b4001bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400c0070 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b400afc40 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b50138350 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400b8400 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b50138910 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.050+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b50138b00 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.054+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b400b6040 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.054+0000 7f5b4cff9640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 0x7f5b3c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.054+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b40120ae0 con 0x7f5b50069d20 2024-01-24T14:01:09.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.054+0000 7f5b4f7fe640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 0x7f5b3c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.054+0000 7f5b4f7fe640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 0x7f5b3c067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b50141c60 tx=0x7f5b44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.058+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f5b400ee5f0 con 0x7f5b50069d20 2024-01-24T14:01:09.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b5004e000 con 0x7f5b50069d20 2024-01-24T14:01:09.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b4cff9640 1 -- 172.21.15.27:0/3760043885 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f5b400f1c10 con 0x7f5b50069d20 2024-01-24T14:01:09.215 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:09.215 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:53.778203+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T14:01:09.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 msgr2=0x7f5b3c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 0x7f5b3c067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b50141c60 tx=0x7f5b44008040 comp rx=0 tx=0).stop 2024-01-24T14:01:09.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 msgr2=0x7f5b50138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5b400b2040 tx=0x7f5b4001bf20 comp rx=0 tx=0).stop 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 shutdown_connections 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f5b3c065a90 0x7f5b3c067f50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f5b50148bf0 0x7f5b5013a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f5b5014a9e0 0x7f5b5014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 --2- 172.21.15.27:0/3760043885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b50069d20 0x7f5b50138e30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 >> 172.21.15.27:0/3760043885 conn(0x7f5b5006ae30 msgr2=0x7f5b500b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 shutdown_connections 2024-01-24T14:01:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.213+0000 7f5b567d0640 1 -- 172.21.15.27:0/3760043885 wait complete. 2024-01-24T14:01:09.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T14:01:09.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T14:01:09.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.349+0000 7fc2d8688640 1 Processor -- start 2024-01-24T14:01:09.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.349+0000 7fc2d8688640 1 -- start start 2024-01-24T14:01:09.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2d0070010 0x7fc2d0070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 0x7fc2d0147630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d0071180 con 0x7fc2d0141700 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00ba1d0 con 0x7fc2d0070010 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00b47f0 con 0x7fc2d0071610 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2d0070010 0x7fc2d0070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6c25640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc2d0141700 0x7fc2d00b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41020/0 (socket says 172.21.15.27:41020) 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc2d0070010 0x7fc2d0070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48882/0 (socket says 172.21.15.27:48882) 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6c25640 1 -- 172.21.15.27:0/3206838962 learned_addr learned my addr 172.21.15.27:0/3206838962 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d5c23640 1 --2- 172.21.15.27:0/3206838962 >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 0x7fc2d0147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 -- 172.21.15.27:0/3206838962 >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 msgr2=0x7fc2d0147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 --2- 172.21.15.27:0/3206838962 >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 0x7fc2d0147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 -- 172.21.15.27:0/3206838962 >> v1:172.21.15.27:6789/0 conn(0x7fc2d0141700 legacy=0x7fc2d00b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 -- 172.21.15.27:0/3206838962 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00b9c10 con 0x7fc2d0070010 2024-01-24T14:01:09.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d5c23640 1 --2- 172.21.15.27:0/3206838962 >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 0x7fc2d0147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d6424640 1 --2- 172.21.15.27:0/3206838962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0070910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097f0 tx=0x7fc2cc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2e99b2481f24af server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d5422640 1 -- 172.21.15.27:0/3206838962 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0ab600 con 0x7fc2d0070010 2024-01-24T14:01:09.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d5422640 1 -- 172.21.15.27:0/3206838962 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0a7050 con 0x7fc2d0070010 2024-01-24T14:01:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d5422640 1 -- 172.21.15.27:0/3206838962 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0ab980 con 0x7fc2d0070010 2024-01-24T14:01:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- 172.21.15.27:0/3206838962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 msgr2=0x7fc2d0070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 --2- 172.21.15.27:0/3206838962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0070910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097f0 tx=0x7fc2cc01c440 comp rx=0 tx=0).stop 2024-01-24T14:01:09.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- 172.21.15.27:0/3206838962 shutdown_connections 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 --2- 172.21.15.27:0/3206838962 >> v2:172.21.15.124:3300/0 conn(0x7fc2d0071610 0x7fc2d0147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 --2- 172.21.15.27:0/3206838962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0070910 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- 172.21.15.27:0/3206838962 >> 172.21.15.27:0/3206838962 conn(0x7fc2d006ae30 msgr2=0x7fc2d006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- 172.21.15.27:0/3206838962 shutdown_connections 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.353+0000 7fc2d8688640 1 -- 172.21.15.27:0/3206838962 wait complete. 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 Processor -- start 2024-01-24T14:01:09.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- start start 2024-01-24T14:01:09.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc2d0071610 0x7fc2d0152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 0x7fc2d0138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0144db0 con 0x7fc2d0070010 2024-01-24T14:01:09.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0146a40 con 0x7fc2d0141700 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0144590 con 0x7fc2d0071610 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48892/0 (socket says 172.21.15.27:48892) 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 -- 172.21.15.27:0/1892099846 learned_addr learned my addr 172.21.15.27:0/1892099846 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6c25640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 0x7fc2d0138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 -- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc2d0071610 msgr2=0x7fc2d0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc2d0071610 0x7fc2d0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 -- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 msgr2=0x7fc2d0138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 0x7fc2d0138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 -- 172.21.15.27:0/1892099846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc009420 con 0x7fc2d0070010 2024-01-24T14:01:09.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6c25640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 0x7fc2d0138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d6424640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097f0 tx=0x7fc2cc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0b4610 con 0x7fc2d0070010 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0b4770 con 0x7fc2d0070010 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d0144830 con 0x7fc2d0070010 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0b4b20 con 0x7fc2d0070010 2024-01-24T14:01:09.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d01429a0 con 0x7fc2d0070010 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d0142b90 con 0x7fc2d0070010 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.357+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2cc0b2040 con 0x7fc2d0070010 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.361+0000 7fc2c6ffd640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 0x7fc2b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.361+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2cc11d210 con 0x7fc2d0070010 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.361+0000 7fc2d5c23640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 0x7fc2b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.361+0000 7fc2d5c23640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 0x7fc2b4067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc2d006b810 tx=0x7fc2c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.365+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fc2cc0eac60 con 0x7fc2d0070010 2024-01-24T14:01:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d004e000 con 0x7fc2d0070010 2024-01-24T14:01:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2c6ffd640 1 -- 172.21.15.27:0/1892099846 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7fc2cc0ee280 con 0x7fc2d0070010 2024-01-24T14:01:09.551 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:09.551 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T14:01:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 msgr2=0x7fc2b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 0x7fc2b4067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc2d006b810 tx=0x7fc2c0008040 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 msgr2=0x7fc2d0146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097f0 tx=0x7fc2cc0191e0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 shutdown_connections 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fc2b4065a60 0x7fc2b4067f20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fc2d0141700 0x7fc2d0138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fc2d0071610 0x7fc2d0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 --2- 172.21.15.27:0/1892099846 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2d0070010 0x7fc2d0146500 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 >> 172.21.15.27:0/1892099846 conn(0x7fc2d006ae30 msgr2=0x7fc2d013b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 shutdown_connections 2024-01-24T14:01:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.549+0000 7fc2d8688640 1 -- 172.21.15.27:0/1892099846 wait complete. 2024-01-24T14:01:09.569 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T14:01:09.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.685+0000 7fd4eea3c640 1 Processor -- start 2024-01-24T14:01:09.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.685+0000 7fd4eea3c640 1 -- start start 2024-01-24T14:01:09.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4eea3c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fd4e8144ea0 0x7fd4e8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4eea3c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4e814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4eea3c640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e806cdc0 con 0x7fd4e814b370 2024-01-24T14:01:09.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4eea3c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e806ee40 con 0x7fd4e8144ea0 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4eea3c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e814b7c0 con 0x7fd4e80b8ad0 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4ecfd9640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd4e814b370 0x7fd4e814e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41034/0 (socket says 172.21.15.27:41034) 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4ecfd9640 1 -- 172.21.15.27:0/2829406117 learned_addr learned my addr 172.21.15.27:0/2829406117 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/2829406117 >> v2:172.21.15.124:3300/0 conn(0x7fd4e8144ea0 0x7fd4e8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e77fe640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4e814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016407729 0 0) 0x7fd4e806cdc0 con 0x7fd4e814b370 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d0003530 con 0x7fd4e814b370 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232259574 0 0) 0x7fd4d0003530 con 0x7fd4e814b370 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 msgr2=0x7fd4e814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4e814ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 >> v2:172.21.15.124:3300/0 conn(0x7fd4e8144ea0 msgr2=0x7fd4e8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 --2- 172.21.15.27:0/2829406117 >> v2:172.21.15.124:3300/0 conn(0x7fd4e8144ea0 0x7fd4e8070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e806c490 con 0x7fd4e814b370 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fd4e0001a00 con 0x7fd4e814b370 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 >> v1:172.21.15.27:6789/0 conn(0x7fd4e814b370 legacy=0x7fd4e814e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0003980 0x7fd4d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0004d10 0x7fd4d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e806ee40 con 0x7fd4d0003980 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e814b7c0 con 0x7fd4d0004d10 2024-01-24T14:01:09.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d000b990 con 0x7fd4e80b8ad0 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0003980 0x7fd4d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4ecfd9640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0004d10 0x7fd4d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e77fe640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 -- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 msgr2=0x7fd4d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e80b8ad0 0x7fd4d00047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 -- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0004d10 msgr2=0x7fd4d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0004d10 0x7fd4d0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.689+0000 7fd4e7fff640 1 -- 172.21.15.27:0/2829406117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0003530 con 0x7fd4d0003980 2024-01-24T14:01:09.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0003980 0x7fd4d0003da0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009ae0 tx=0x7fd4dc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baabd7e6652a28cc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0a5680 con 0x7fd4d0003980 2024-01-24T14:01:09.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc0a57e0 con 0x7fd4d0003980 2024-01-24T14:01:09.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e6ffd640 1 -- 172.21.15.27:0/2829406117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0a5b90 con 0x7fd4d0003980 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/2829406117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0003980 msgr2=0x7fd4d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/2829406117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4d0003980 0x7fd4d0003da0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009ae0 tx=0x7fd4dc01ca90 comp rx=0 tx=0).stop 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4ecfd9640 1 -- 172.21.15.27:0/2829406117 reap_dead start 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/2829406117 shutdown_connections 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/2829406117 >> 172.21.15.27:0/2829406117 conn(0x7fd4e80be150 msgr2=0x7fd4e80be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/2829406117 shutdown_connections 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/2829406117 wait complete. 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 Processor -- start 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- start start 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0003980 0x7fd4e80bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e8139820 0x7fd4e8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80bde50 con 0x7fd4e8143890 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80a32f0 con 0x7fd4d0003980 2024-01-24T14:01:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8140590 con 0x7fd4e8139820 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48924/0 (socket says 172.21.15.27:48924) 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 -- 172.21.15.27:0/1265123454 learned_addr learned my addr 172.21.15.27:0/1265123454 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0003980 0x7fd4e80bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 -- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e8139820 msgr2=0x7fd4e8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4ecfd9640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e8139820 0x7fd4e8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e8139820 0x7fd4e8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 -- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0003980 msgr2=0x7fd4e80bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0003980 0x7fd4e80bd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 -- 172.21.15.27:0/1265123454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80a2ca0 con 0x7fd4e8143890 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e77fe640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8010890 tx=0x7fd4d8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8009630 con 0x7fd4e8143890 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800eb60 con 0x7fd4e8143890 2024-01-24T14:01:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e80a2f80 con 0x7fd4e8143890 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d801c400 con 0x7fd4e8143890 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.693+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e8144250 con 0x7fd4e8143890 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8071a20 con 0x7fd4e8143890 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4d801c560 con 0x7fd4e8143890 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4e4ff9640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 0x7fd4d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:09.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d8083750 con 0x7fd4e8143890 2024-01-24T14:01:09.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 0x7fd4d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:09.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.697+0000 7fd4e7fff640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 0x7fd4d4067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0af000 tx=0x7fd4dc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:09.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.701+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fd4d8051110 con 0x7fd4e8143890 2024-01-24T14:01:09.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.889+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4e804e000 con 0x7fd4e8143890 2024-01-24T14:01:09.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.889+0000 7fd4e4ff9640 1 -- 172.21.15.27:0/1265123454 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3977 (secure 0 0 0) 0x7fd4d8054730 con 0x7fd4e8143890 2024-01-24T14:01:09.892 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:09.892 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-24T12:44:52.773516+0000","modified":"2024-01-24T12:44:54.787781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/555930639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":555930639},{"type":"v1","addr":"172.21.15.27:6835","nonce":555930639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-24T14:01:09.893 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-01-24T14:01:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 msgr2=0x7fd4d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 0x7fd4d4067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0af000 tx=0x7fd4dc0046d0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 msgr2=0x7fd4e8143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8010890 tx=0x7fd4d8010d50 comp rx=0 tx=0).stop 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 shutdown_connections 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fd4d4065a60 0x7fd4d4067f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fd4e8139820 0x7fd4e8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd4e8143890 0x7fd4e8143d10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 --2- 172.21.15.27:0/1265123454 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fd4d0003980 0x7fd4e80bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 >> 172.21.15.27:0/1265123454 conn(0x7fd4e80be150 msgr2=0x7fd4e80b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 shutdown_connections 2024-01-24T14:01:09.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:09.893+0000 7fd4eea3c640 1 -- 172.21.15.27:0/1265123454 wait complete. 2024-01-24T14:01:09.910 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T14:01:10.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 Processor -- start 2024-01-24T14:01:10.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 -- start start 2024-01-24T14:01:10.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26e00b9900 0x7f26e00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f26e01429f0 0x7f26e0153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00b3c40 con 0x7f26e0071160 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00b5140 con 0x7f26e00b9900 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e7d62640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00b9d50 con 0x7f26e01429f0 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e52fd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26e00b9900 0x7f26e00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e52fd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f26e00b9900 0x7f26e00b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48936/0 (socket says 172.21.15.27:48936) 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e52fd640 1 -- 172.21.15.27:0/1382209639 learned_addr learned my addr 172.21.15.27:0/1382209639 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.017+0000 7f26e62ff640 1 --2- 172.21.15.27:0/1382209639 >> v2:172.21.15.124:3300/0 conn(0x7f26e01429f0 0x7f26e0153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e52fd640 1 -- 172.21.15.27:0/1382209639 >> v2:172.21.15.124:3300/0 conn(0x7f26e01429f0 msgr2=0x7f26e0153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e52fd640 1 --2- 172.21.15.27:0/1382209639 >> v2:172.21.15.124:3300/0 conn(0x7f26e01429f0 0x7f26e0153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e52fd640 1 -- 172.21.15.27:0/1382209639 >> v1:172.21.15.124:6789/0 conn(0x7f26e0071160 legacy=0x7f26e00b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e52fd640 1 -- 172.21.15.27:0/1382209639 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00b9f60 con 0x7f26e00b9900 2024-01-24T14:01:10.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e52fd640 1 --2- 172.21.15.27:0/1382209639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e00b42d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f26e00b32c0 tx=0x7f26d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800ef60eac3eda97 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e4afc640 1 -- 172.21.15.27:0/1382209639 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00ab650 con 0x7f26e00b9900 2024-01-24T14:01:10.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e4afc640 1 -- 172.21.15.27:0/1382209639 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d00ab7b0 con 0x7f26e00b9900 2024-01-24T14:01:10.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e4afc640 1 -- 172.21.15.27:0/1382209639 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00abb40 con 0x7f26e00b9900 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 -- 172.21.15.27:0/1382209639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 msgr2=0x7f26e00b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 --2- 172.21.15.27:0/1382209639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e00b42d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f26e00b32c0 tx=0x7f26d001c430 comp rx=0 tx=0).stop 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 -- 172.21.15.27:0/1382209639 shutdown_connections 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 --2- 172.21.15.27:0/1382209639 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e00b42d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 --2- 172.21.15.27:0/1382209639 >> v2:172.21.15.124:3300/0 conn(0x7f26e01429f0 0x7f26e0153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 -- 172.21.15.27:0/1382209639 >> 172.21.15.27:0/1382209639 conn(0x7f26e00be150 msgr2=0x7f26e00be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 -- 172.21.15.27:0/1382209639 shutdown_connections 2024-01-24T14:01:10.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 -- 172.21.15.27:0/1382209639 wait complete. 2024-01-24T14:01:10.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.021+0000 7f26e7d62640 1 Processor -- start 2024-01-24T14:01:10.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- start start 2024-01-24T14:01:10.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26e0071160 0x7f26e013fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e01429f0 0x7f26e01302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0140040 con 0x7f26e00b9900 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e0141a00 con 0x7f26e01429f0 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01414b0 con 0x7f26e0071160 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48950/0 (socket says 172.21.15.27:48950) 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 -- 172.21.15.27:0/2756500854 learned_addr learned my addr 172.21.15.27:0/2756500854 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e62ff640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e01429f0 0x7f26e01302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 -- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26e0071160 msgr2=0x7f26e013fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26e0071160 0x7f26e013fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 -- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e01429f0 msgr2=0x7f26e01302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e01429f0 0x7f26e01302f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 -- 172.21.15.27:0/2756500854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00094d0 con 0x7f26e00b9900 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e52fd640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26d001a060 tx=0x7f26d001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00b4800 con 0x7f26e00b9900 2024-01-24T14:01:10.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d00b4960 con 0x7f26e00b9900 2024-01-24T14:01:10.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e006cc30 con 0x7f26e00b9900 2024-01-24T14:01:10.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00b4d10 con 0x7f26e00b9900 2024-01-24T14:01:10.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e0141720 con 0x7f26e00b9900 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e006aec0 con 0x7f26e00b9900 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26d00c7440 con 0x7f26e00b9900 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 0x7f26c4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d011de60 con 0x7f26e00b9900 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.025+0000 7f26e5afe640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 0x7f26c4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.029+0000 7f26e5afe640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 0x7f26c4067ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26dc003cf0 tx=0x7f26dc0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.029+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f26d00eba30 con 0x7f26e00b9900 2024-01-24T14:01:10.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.185+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26e006aec0 con 0x7f26e00b9900 2024-01-24T14:01:10.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.185+0000 7f26d67fc640 1 -- 172.21.15.27:0/2756500854 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f26e006aec0 con 0x7f26e00b9900 2024-01-24T14:01:10.190 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:10.190 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T12:44:53.778203+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-24T12:44:51.275830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-24T12:44:51.757229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 msgr2=0x7f26c4067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 0x7f26c4067ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26dc003cf0 tx=0x7f26dc0079c0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 msgr2=0x7f26e006c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26d001a060 tx=0x7f26d001ac70 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 shutdown_connections 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f26c4065a30 0x7f26c4067ef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f26e01429f0 0x7f26e01302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f26e00b9900 0x7f26e006c270 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 --2- 172.21.15.27:0/2756500854 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f26e0071160 0x7f26e013fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 >> 172.21.15.27:0/2756500854 conn(0x7f26e00be150 msgr2=0x7f26e00a2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 shutdown_connections 2024-01-24T14:01:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.189+0000 7f26e7d62640 1 -- 172.21.15.27:0/2756500854 wait complete. 2024-01-24T14:01:10.207 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-24T14:01:10.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 Processor -- start 2024-01-24T14:01:10.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 -- start start 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6f780b8ce0 0x7f6f780717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f6f780b8820 0x7f6f78071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f78071350 con 0x7f6f7806aaa0 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7806fe30 con 0x7f6f780b8ce0 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7ed7d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7806f590 con 0x7f6f780b8820 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7cb19640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6f7806aaa0 0x7f6f781426c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41046/0 (socket says 172.21.15.27:41046) 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7cb19640 1 -- 172.21.15.27:0/1357748151 learned_addr learned my addr 172.21.15.27:0/1357748151 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1357748151 >> v2:172.21.15.27:3300/0 conn(0x7f6f780b8ce0 0x7f6f780717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f7d31a640 1 --2- 172.21.15.27:0/1357748151 >> v2:172.21.15.124:3300/0 conn(0x7f6f780b8820 0x7f6f78071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f777fe640 1 -- 172.21.15.27:0/1357748151 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247449741 0 0) 0x7f6f78071350 con 0x7f6f7806aaa0 2024-01-24T14:01:10.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f777fe640 1 -- 172.21.15.27:0/1357748151 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f64003530 con 0x7f6f7806aaa0 2024-01-24T14:01:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f77fff640 1 -- 172.21.15.27:0/1357748151 >> v2:172.21.15.124:3300/0 conn(0x7f6f780b8820 msgr2=0x7f6f78071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1357748151 >> v2:172.21.15.124:3300/0 conn(0x7f6f780b8820 0x7f6f78071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f77fff640 1 -- 172.21.15.27:0/1357748151 >> v1:172.21.15.27:6789/0 conn(0x7f6f7806aaa0 legacy=0x7f6f781426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.329+0000 7f6f77fff640 1 -- 172.21.15.27:0/1357748151 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7806f870 con 0x7f6f780b8ce0 2024-01-24T14:01:10.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1357748151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8ce0 0x7f6f780717c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6f78066900 tx=0x7f6f6001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce84b5c79b6e003 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f777fe640 1 -- 172.21.15.27:0/1357748151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600a8950 con 0x7f6f780b8ce0 2024-01-24T14:01:10.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f777fe640 1 -- 172.21.15.27:0/1357748151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600a8ab0 con 0x7f6f780b8ce0 2024-01-24T14:01:10.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f777fe640 1 -- 172.21.15.27:0/1357748151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600a8e40 con 0x7f6f780b8ce0 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1357748151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8ce0 msgr2=0x7f6f780717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1357748151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8ce0 0x7f6f780717c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6f78066900 tx=0x7f6f6001ec50 comp rx=0 tx=0).stop 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1357748151 shutdown_connections 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1357748151 >> v2:172.21.15.124:3300/0 conn(0x7f6f780b8820 0x7f6f78071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1357748151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8ce0 0x7f6f780717c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1357748151 >> 172.21.15.27:0/1357748151 conn(0x7f6f78069d20 msgr2=0x7f6f7806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1357748151 shutdown_connections 2024-01-24T14:01:10.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1357748151 wait complete. 2024-01-24T14:01:10.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 Processor -- start 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- start start 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f7806aaa0 0x7f6f7813ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f78146ff0 0x7f6f78148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78138110 con 0x7f6f780b8820 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7813e2f0 con 0x7f6f78146ff0 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f7ed7d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78147520 con 0x7f6f7806aaa0 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.333+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48964/0 (socket says 172.21.15.27:48964) 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 -- 172.21.15.27:0/1159667821 learned_addr learned my addr 172.21.15.27:0/1159667821 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7cb19640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f7806aaa0 0x7f6f7813ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7d31a640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f78146ff0 0x7f6f78148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 -- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f7806aaa0 msgr2=0x7f6f7813ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f7806aaa0 0x7f6f7813ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 -- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f78146ff0 msgr2=0x7f6f78148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f78146ff0 0x7f6f78148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 -- 172.21.15.27:0/1159667821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009420 con 0x7f6f780b8820 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f77fff640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f6001b860 tx=0x7f6f6001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b0dd0 con 0x7f6f780b8820 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600bb440 con 0x7f6f780b8820 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78138300 con 0x7f6f780b8820 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600bb7b0 con 0x7f6f780b8820 2024-01-24T14:01:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f78148000 con 0x7f6f780b8820 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f781481f0 con 0x7f6f780b8820 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f600b7040 con 0x7f6f780b8820 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 0x7f6f58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f60121000 con 0x7f6f780b8820 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7cb19640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 0x7f6f58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.337+0000 7f6f7cb19640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 0x7f6f58067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f70001570 tx=0x7f6f70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.341+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f6f600eeb70 con 0x7f6f780b8820 2024-01-24T14:01:10.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.529+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6f7804e000 con 0x7f6f780b8820 2024-01-24T14:01:10.565 INFO:tasks.ceph.mon.a.smithi027.stderr:2024-01-24T14:01:10.561+0000 7f3ce1fed640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-24T14:01:10.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.581+0000 7f6f757fa640 1 -- 172.21.15.27:0/1159667821 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f600f2190 con 0x7f6f780b8820 2024-01-24T14:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 msgr2=0x7f6f58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 0x7f6f58067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f70001570 tx=0x7f6f70009040 comp rx=0 tx=0).stop 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 msgr2=0x7f6f78148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f6001b860 tx=0x7f6f6001b9f0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 shutdown_connections 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6f58065a60 0x7f6f58067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f6f78146ff0 0x7f6f78148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6f780b8820 0x7f6f78148520 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 --2- 172.21.15.27:0/1159667821 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f6f7806aaa0 0x7f6f7813ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 >> 172.21.15.27:0/1159667821 conn(0x7f6f78069d20 msgr2=0x7f6f78141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 shutdown_connections 2024-01-24T14:01:10.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.585+0000 7f6f7ed7d640 1 -- 172.21.15.27:0/1159667821 wait complete. 2024-01-24T14:01:10.611 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-24T14:01:10.688 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-24T14:01:10.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.717+0000 7fb563c9a640 1 Processor -- start 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb563c9a640 1 -- start start 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb563c9a640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fb55c06f630 0x7fb55c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb563c9a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c06f0b0 con 0x7fb55c06b8d0 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb563c9a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c1451d0 con 0x7fb55c06b090 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb563c9a640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c14aad0 con 0x7fb55c06f630 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb55c06b8d0 0x7fb55c1553e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:41074/0 (socket says 172.21.15.27:41074) 2024-01-24T14:01:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 -- 172.21.15.27:0/2291736430 learned_addr learned my addr 172.21.15.27:0/2291736430 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822258976 0 0) 0x7fb55c06f0b0 con 0x7fb55c06b8d0 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb548003530 con 0x7fb55c06b8d0 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb561235640 1 --2- 172.21.15.27:0/2291736430 >> v2:172.21.15.124:3300/0 conn(0x7fb55c06f630 0x7fb55c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852198994 0 0) 0x7fb548003530 con 0x7fb55c06b8d0 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 >> v2:172.21.15.124:3300/0 conn(0x7fb55c06f630 msgr2=0x7fb55c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 --2- 172.21.15.27:0/2291736430 >> v2:172.21.15.124:3300/0 conn(0x7fb55c06f630 0x7fb55c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 >> v1:172.21.15.124:6789/0 conn(0x7fb55c06b090 legacy=0x7fb55c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c06f350 con 0x7fb55c06b8d0 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fb554001a00 con 0x7fb55c06b8d0 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb561235640 1 --2- 172.21.15.27:0/2291736430 >> v2:172.21.15.124:3300/0 conn(0x7fb55c06f630 0x7fb55c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 >> v1:172.21.15.27:6789/0 conn(0x7fb55c06b8d0 legacy=0x7fb55c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548003980 0x7fb548003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 0x7fb54800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c14aad0 con 0x7fb548005190 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54800c0c0 con 0x7fb548003980 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54800c280 con 0x7fb5480047d0 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 0x7fb54800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb561235640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb561a36640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548003980 0x7fb548003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 -- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5480047d0 msgr2=0x7fb548004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 -- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548003980 msgr2=0x7fb548003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548003980 0x7fb548003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 -- 172.21.15.27:0/2291736430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548003530 con 0x7fb548005190 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb561a36640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb548003980 0x7fb548003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.721+0000 7fb562237640 1 -- 172.21.15.27:0/2291736430 reap_dead start 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb562237640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 0x7fb54800b990 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb55400a7f0 tx=0x7fb55401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a46351f85a6f1c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540072d0 con 0x7fb548005190 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540a8070 con 0x7fb548005190 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb560a34640 1 -- 172.21.15.27:0/2291736430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554007670 con 0x7fb548005190 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 msgr2=0x7fb54800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 0x7fb54800b990 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb55400a7f0 tx=0x7fb55401d300 comp rx=0 tx=0).stop 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2291736430 shutdown_connections 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2291736430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb548005190 0x7fb54800b990 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2291736430 >> 172.21.15.27:0/2291736430 conn(0x7fb55c0babc0 msgr2=0x7fb55c0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2291736430 shutdown_connections 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2291736430 wait complete. 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 Processor -- start 2024-01-24T14:01:10.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- start start 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb548005190 0x7fb55c1e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 0x7fb55c0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c14adb0 con 0x7fb55c0a2920 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b77b0 con 0x7fb55c0b7a90 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b5e40 con 0x7fb548005190 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48998/0 (socket says 172.21.15.27:48998) 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 -- 172.21.15.27:0/2142696278 learned_addr learned my addr 172.21.15.27:0/2142696278 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb562237640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 0x7fb55c0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561a36640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb548005190 0x7fb55c1e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 -- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb548005190 msgr2=0x7fb55c1e37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb548005190 0x7fb55c1e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 -- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 msgr2=0x7fb55c0b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 0x7fb55c0b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 -- 172.21.15.27:0/2142696278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0b6de0 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb562237640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 0x7fb55c0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb561235640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00f4e0 tx=0x7fb54c00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c014890 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00c030 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0b58b0 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c014c30 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.725+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0b5b60 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c04e000 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb54c0133e0 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb5527fc640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 0x7fb540067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb54c083490 con 0x7fb55c0a2920 2024-01-24T14:01:10.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb561a36640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 0x7fb540067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.729+0000 7fb561a36640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 0x7fb540067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb558000f70 tx=0x7fb558009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:10.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.733+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb54c050e80 con 0x7fb55c0a2920 2024-01-24T14:01:10.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:10.921+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb55c0b8570 con 0x7fb55c0a2920 2024-01-24T14:01:11.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.585+0000 7fb5527fc640 1 -- 172.21.15.27:0/2142696278 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb54c0544a0 con 0x7fb55c0a2920 2024-01-24T14:01:11.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 msgr2=0x7fb540067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 0x7fb540067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb558000f70 tx=0x7fb558009040 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 msgr2=0x7fb55c0b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00f4e0 tx=0x7fb54c00f9a0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 shutdown_connections 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb540065a60 0x7fb540067f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb55c0b7a90 0x7fb55c0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb55c0a2920 0x7fb55c0b7270 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 --2- 172.21.15.27:0/2142696278 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb548005190 0x7fb55c1e37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 >> 172.21.15.27:0/2142696278 conn(0x7fb55c0babc0 msgr2=0x7fb55c0b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 shutdown_connections 2024-01-24T14:01:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.589+0000 7fb563c9a640 1 -- 172.21.15.27:0/2142696278 wait complete. 2024-01-24T14:01:11.606 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-24T14:01:11.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 Processor -- start 2024-01-24T14:01:11.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 -- start start 2024-01-24T14:01:11.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe60142720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efe600b3e60 0x7efe60153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600b7df0 con 0x7efe600b6880 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600b8e50 con 0x7efe600b3e60 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe67581640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600b8070 con 0x7efe600b9270 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe6531d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efe600b6880 0x7efe6014bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36764/0 (socket says 172.21.15.27:36764) 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe6531d640 1 -- 172.21.15.27:0/2626192898 learned_addr learned my addr 172.21.15.27:0/2626192898 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 --2- 172.21.15.27:0/2626192898 >> v2:172.21.15.124:3300/0 conn(0x7efe600b3e60 0x7efe60153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201674725 0 0) 0x7efe600b7df0 con 0x7efe600b6880 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe4c003530 con 0x7efe600b6880 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe64b1c640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe60142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972355939 0 0) 0x7efe4c003530 con 0x7efe600b6880 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 msgr2=0x7efe60142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe60142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 >> v2:172.21.15.124:3300/0 conn(0x7efe600b3e60 msgr2=0x7efe60153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 --2- 172.21.15.27:0/2626192898 >> v2:172.21.15.124:3300/0 conn(0x7efe600b3e60 0x7efe60153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600b8a70 con 0x7efe600b6880 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7efe5c001680 con 0x7efe600b6880 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 >> v1:172.21.15.27:6789/0 conn(0x7efe600b6880 legacy=0x7efe6014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c003980 0x7efe4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600b8e50 con 0x7efe4c004d10 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600b8070 con 0x7efe4c003980 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c00ba90 con 0x7efe600b9270 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe64b1c640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe6531d640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c003980 0x7efe4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 -- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 msgr2=0x7efe4c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe600b9270 0x7efe4c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 -- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c003980 msgr2=0x7efe4c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe4c003980 0x7efe4c003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.721+0000 7efe65b1e640 1 -- 172.21.15.27:0/2626192898 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c003530 con 0x7efe4c004d10 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe65b1e640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe4c005190 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe58009fc0 tx=0x7efe5801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4725b074dc91f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580a5c70 con 0x7efe4c004d10 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5800f040 con 0x7efe4c004d10 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe57fff640 1 -- 172.21.15.27:0/2626192898 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580ad440 con 0x7efe4c004d10 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- 172.21.15.27:0/2626192898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 msgr2=0x7efe4c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 --2- 172.21.15.27:0/2626192898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe4c005190 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe58009fc0 tx=0x7efe5801cc60 comp rx=0 tx=0).stop 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe65b1e640 1 -- 172.21.15.27:0/2626192898 reap_dead start 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- 172.21.15.27:0/2626192898 shutdown_connections 2024-01-24T14:01:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- 172.21.15.27:0/2626192898 >> 172.21.15.27:0/2626192898 conn(0x7efe600bcf70 msgr2=0x7efe600bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:11.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- 172.21.15.27:0/2626192898 shutdown_connections 2024-01-24T14:01:11.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- 172.21.15.27:0/2626192898 wait complete. 2024-01-24T14:01:11.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 Processor -- start 2024-01-24T14:01:11.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.725+0000 7efe67581640 1 -- start start 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 0x7efe6014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 0x7efe60148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe601de6e0 con 0x7efe4c004d10 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6014c250 con 0x7efe6014ab50 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6014afe0 con 0x7efe60149860 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39242/0 (socket says 172.21.15.27:39242) 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 -- 172.21.15.27:0/3281225068 learned_addr learned my addr 172.21.15.27:0/3281225068 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe64b1c640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 0x7efe6014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe65b1e640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 0x7efe60148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 -- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 msgr2=0x7efe6014a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 0x7efe6014a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 -- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 msgr2=0x7efe60148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 0x7efe60148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 -- 172.21.15.27:0/3281225068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe601ddd40 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe64b1c640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 0x7efe6014a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe65b1e640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 0x7efe60148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe6531d640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efe5c010c60 tx=0x7efe5c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c010e70 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c0143a0 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c014730 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe601de020 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe601dd9a0 con 0x7efe4c004d10 2024-01-24T14:01:11.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe601de820 con 0x7efe4c004d10 2024-01-24T14:01:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe5c014890 con 0x7efe4c004d10 2024-01-24T14:01:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 0x7efe44067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efe5c085d30 con 0x7efe4c004d10 2024-01-24T14:01:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.729+0000 7efe64b1c640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 0x7efe44067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:11.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.733+0000 7efe64b1c640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 0x7efe44067f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe6013d950 tx=0x7efe50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:11.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.733+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efe601de820 con 0x7efe4c004d10 2024-01-24T14:01:11.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:11.889+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe601de820 con 0x7efe4c004d10 2024-01-24T14:01:12.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.593+0000 7efe55ffb640 1 -- 172.21.15.27:0/3281225068 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7efe601de820 con 0x7efe4c004d10 2024-01-24T14:01:12.594 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2024-01-24T14:01:12.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 msgr2=0x7efe44067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 0x7efe44067f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe6013d950 tx=0x7efe50008040 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 msgr2=0x7efe6014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efe5c010c60 tx=0x7efe5c00e4d0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 shutdown_connections 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efe44065a90 0x7efe44067f50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efe6014ab50 0x7efe60148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efe60149860 0x7efe6014a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 --2- 172.21.15.27:0/3281225068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe4c004d10 0x7efe6014bd10 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 >> 172.21.15.27:0/3281225068 conn(0x7efe600bcf70 msgr2=0x7efe600bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 shutdown_connections 2024-01-24T14:01:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.597+0000 7efe67581640 1 -- 172.21.15.27:0/3281225068 wait complete. 2024-01-24T14:01:12.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-24T14:01:12.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 Processor -- start 2024-01-24T14:01:12.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 -- start start 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f66340b44a0 0x7f66341427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66340a0c90 0x7f66341531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66340a0c90 0x7f66341531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f66340a0c90 0x7f66341531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39244/0 (socket says 172.21.15.27:39244) 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 -- 172.21.15.27:0/1023981701 learned_addr learned my addr 172.21.15.27:0/1023981701 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663406e220 con 0x7f66340b5060 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340ba850 con 0x7f66340a0c90 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663406df40 con 0x7f66340b44a0 2024-01-24T14:01:12.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f66395c5640 1 --2- 172.21.15.27:0/1023981701 >> v2:172.21.15.124:3300/0 conn(0x7f66340b44a0 0x7f66341427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 -- 172.21.15.27:0/1023981701 >> v2:172.21.15.124:3300/0 conn(0x7f66340b44a0 msgr2=0x7f66341427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 --2- 172.21.15.27:0/1023981701 >> v2:172.21.15.124:3300/0 conn(0x7f66340b44a0 0x7f66341427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 -- 172.21.15.27:0/1023981701 >> v1:172.21.15.124:6789/0 conn(0x7f66340b5060 legacy=0x7f6634148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f6639dc6640 1 -- 172.21.15.27:0/1023981701 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634148a00 con 0x7f66340a0c90 2024-01-24T14:01:12.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.833+0000 7f662bfff640 1 -- 172.21.15.27:0/1023981701 <== mon.1 v1:172.21.15.124:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691161179 0 0) 0x7f663406e220 con 0x7f66340b5060 2024-01-24T14:01:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f6639dc6640 1 --2- 172.21.15.27:0/1023981701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340a0c90 0x7f66341531e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f662c009e50 tx=0x7f662c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1392a697b4992c server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:12.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f662bfff640 1 -- 172.21.15.27:0/1023981701 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0a57a0 con 0x7f66340a0c90 2024-01-24T14:01:12.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f662bfff640 1 -- 172.21.15.27:0/1023981701 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0a5900 con 0x7f66340a0c90 2024-01-24T14:01:12.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f662bfff640 1 -- 172.21.15.27:0/1023981701 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0a5c90 con 0x7f66340a0c90 2024-01-24T14:01:12.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340a0c90 msgr2=0x7f66341531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 --2- 172.21.15.27:0/1023981701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340a0c90 0x7f66341531e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f662c009e50 tx=0x7f662c01c9f0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 shutdown_connections 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 --2- 172.21.15.27:0/1023981701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340a0c90 0x7f66341531e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 --2- 172.21.15.27:0/1023981701 >> v2:172.21.15.124:3300/0 conn(0x7f66340b44a0 0x7f66341427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 >> 172.21.15.27:0/1023981701 conn(0x7f66340babc0 msgr2=0x7f66340bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 shutdown_connections 2024-01-24T14:01:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.837+0000 7f663b829640 1 -- 172.21.15.27:0/1023981701 wait complete. 2024-01-24T14:01:12.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 Processor -- start 2024-01-24T14:01:12.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 -- start start 2024-01-24T14:01:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 0x7f66340b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340b7720 con 0x7f66340b5060 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341e2260 con 0x7f66340b44a0 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f66395c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f6639dc6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 0x7f66340b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f6638dc4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f6639dc6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 0x7f66340b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39256/0 (socket says 172.21.15.27:39256) 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f66395c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:35546/0 (socket says 172.21.15.27:35546) 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f6639dc6640 1 -- 172.21.15.27:0/3901303313 learned_addr learned my addr 172.21.15.27:0/3901303313 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f6638dc4640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3300/0 says I am v2:172.21.15.27:47138/0 (socket says 172.21.15.27:47138) 2024-01-24T14:01:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.841+0000 7f663b829640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a1200 con 0x7f66340a0c90 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 -- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 msgr2=0x7f6634145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 -- 172.21.15.27:0/3901303313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 msgr2=0x7f66340b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 0x7f66340b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009b30 con 0x7f66340b44a0 2024-01-24T14:01:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f66395c5640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T14:01:12.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6638dc4640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6624001e50 tx=0x7f6624001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:12.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240054e0 con 0x7f66340b44a0 2024-01-24T14:01:12.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624011620 con 0x7f66340b44a0 2024-01-24T14:01:12.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f663b829640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66341e1ca0 con 0x7f66340b44a0 2024-01-24T14:01:12.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240119d0 con 0x7f66340b44a0 2024-01-24T14:01:12.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.845+0000 7f663b829640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340b55e0 con 0x7f66340b44a0 2024-01-24T14:01:12.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c005260 con 0x7f66340b44a0 2024-01-24T14:01:12.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6624017020 con 0x7f66340b44a0 2024-01-24T14:01:12.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f6629ffb640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 0x7f6618067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:12.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6624086970 con 0x7f66340b44a0 2024-01-24T14:01:12.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f66395c5640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 0x7f6618067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:12.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.849+0000 7f66395c5640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 0x7f6618067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c60 tx=0x7f6630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:12.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:12.861+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f66240545d0 con 0x7f66340b44a0 2024-01-24T14:01:13.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.017+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f660c005510 con 0x7f66340b44a0 2024-01-24T14:01:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.613+0000 7f6629ffb640 1 -- 172.21.15.27:0/3901303313 <== mon.1 v2:172.21.15.124:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f662401f020 con 0x7f66340b44a0 2024-01-24T14:01:13.625 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2024-01-24T14:01:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 msgr2=0x7f6618067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 0x7f6618067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c60 tx=0x7f6630008040 comp rx=0 tx=0).stop 2024-01-24T14:01:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 msgr2=0x7f66340b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6624001e50 tx=0x7f6624001e80 comp rx=0 tx=0).stop 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 shutdown_connections 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f6618065a60 0x7f6618067f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66340b5060 0x7f66340b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f66340b44a0 0x7f66340b6da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 --2- 172.21.15.27:0/3901303313 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f66340a0c90 0x7f6634145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 >> 172.21.15.27:0/3901303313 conn(0x7f66340babc0 msgr2=0x7f6634146d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 shutdown_connections 2024-01-24T14:01:13.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.645+0000 7f661f7fe640 1 -- 172.21.15.27:0/3901303313 wait complete. 2024-01-24T14:01:13.668 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-24T14:01:13.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.833+0000 7fdcbbedf640 1 Processor -- start 2024-01-24T14:01:13.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.833+0000 7fdcbbedf640 1 -- start start 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcbbedf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb40b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcbbedf640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdcb406fc40 0x7fdcb4159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdcb406fc40 0x7fdcb4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fdcb406fc40 0x7fdcb4159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39264/0 (socket says 172.21.15.27:39264) 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 -- 172.21.15.27:0/1114105254 learned_addr learned my addr 172.21.15.27:0/1114105254 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb4149430 con 0x7fdcb414ed50 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcb9c7b640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb40b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb406a430 con 0x7fdcb406fc40 2024-01-24T14:01:13.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40b8d40 con 0x7fdcb4149050 2024-01-24T14:01:13.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 -- 172.21.15.27:0/1114105254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 msgr2=0x7fdcb40b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:13.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb40b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 -- 172.21.15.27:0/1114105254 >> v1:172.21.15.124:6789/0 conn(0x7fdcb414ed50 legacy=0x7fdcb4069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.837+0000 7fdcba47c640 1 -- 172.21.15.27:0/1114105254 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb40b8040 con 0x7fdcb406fc40 2024-01-24T14:01:13.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcba47c640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb4159660 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009e50 tx=0x7fdcac01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb56b6be86982283 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:13.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcb8c79640 1 -- 172.21.15.27:0/1114105254 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0af400 con 0x7fdcb406fc40 2024-01-24T14:01:13.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcb8c79640 1 -- 172.21.15.27:0/1114105254 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0ab050 con 0x7fdcb406fc40 2024-01-24T14:01:13.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcb8c79640 1 -- 172.21.15.27:0/1114105254 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0af780 con 0x7fdcb406fc40 2024-01-24T14:01:13.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 msgr2=0x7fdcb4159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb4159660 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009e50 tx=0x7fdcac01f1f0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 shutdown_connections 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb4159660 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/1114105254 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb40b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 >> 172.21.15.27:0/1114105254 conn(0x7fdcb40bcf70 msgr2=0x7fdcb40bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 shutdown_connections 2024-01-24T14:01:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.849+0000 7fdcbbedf640 1 -- 172.21.15.27:0/1114105254 wait complete. 2024-01-24T14:01:13.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 Processor -- start 2024-01-24T14:01:13.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 -- start start 2024-01-24T14:01:13.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb41e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdcb414ed50 0x7fdcb4152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39272/0 (socket says 172.21.15.27:39272) 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb947a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb41e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb947a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb41e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:35564/0 (socket says 172.21.15.27:35564) 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40a7a10 con 0x7fdcb406fc40 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb414e650 con 0x7fdcb414ed50 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcbbedf640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40a7f50 con 0x7fdcb4149050 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 -- 172.21.15.27:0/158418797 learned_addr learned my addr 172.21.15.27:0/158418797 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:13.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcba47c640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdcb414ed50 0x7fdcb4152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 -- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 msgr2=0x7fdcb41e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb41e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 -- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdcb414ed50 msgr2=0x7fdcb4152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdcb414ed50 0x7fdcb4152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 -- 172.21.15.27:0/158418797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009b30 con 0x7fdcb406fc40 2024-01-24T14:01:13.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.853+0000 7fdcb9c7b640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000e930 tx=0x7fdcb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:13.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.861+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0009690 con 0x7fdcb406fc40 2024-01-24T14:01:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.861+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40a8230 con 0x7fdcb406fc40 2024-01-24T14:01:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.861+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb40a8a30 con 0x7fdcb406fc40 2024-01-24T14:01:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.865+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000ca00 con 0x7fdcb406fc40 2024-01-24T14:01:13.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.865+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000cd70 con 0x7fdcb406fc40 2024-01-24T14:01:13.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.873+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c005260 con 0x7fdcb406fc40 2024-01-24T14:01:13.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.873+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdcb0013470 con 0x7fdcb406fc40 2024-01-24T14:01:13.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.873+0000 7fdcaa7fc640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 0x7fdca0068150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.873+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcb00830f0 con 0x7fdcb406fc40 2024-01-24T14:01:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.873+0000 7fdcb947a640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 0x7fdca0068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.877+0000 7fdcb947a640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 0x7fdca0068150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40a7640 tx=0x7fdca4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:13.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:13.881+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fdcb0050f00 con 0x7fdcb406fc40 2024-01-24T14:01:14.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.873+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc9c005a90 con 0x7fdcb406fc40 2024-01-24T14:01:14.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.881+0000 7fdcaa7fc640 1 -- 172.21.15.27:0/158418797 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdcb0054520 con 0x7fdcb406fc40 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 msgr2=0x7fdca0068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 0x7fdca0068150 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40a7640 tx=0x7fdca4009040 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 msgr2=0x7fdcb414e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000e930 tx=0x7fdcb000edf0 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 shutdown_connections 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fdca0065c90 0x7fdca0068150 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fdcb414ed50 0x7fdcb4152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fdcb4149050 0x7fdcb41e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 --2- 172.21.15.27:0/158418797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcb406fc40 0x7fdcb414e110 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 >> 172.21.15.27:0/158418797 conn(0x7fdcb40bcf70 msgr2=0x7fdcb40bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 shutdown_connections 2024-01-24T14:01:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:14.965+0000 7fdcbbedf640 1 -- 172.21.15.27:0/158418797 wait complete. 2024-01-24T14:01:15.006 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-01-24T14:01:15.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 Processor -- start 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 -- start start 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4f806ee70 0x7ff4f815b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80b76b0 con 0x7ff4f815b8c0 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80bc300 con 0x7ff4f80b7f40 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4fca89640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80b3110 con 0x7ff4f806ee70 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4f5d9b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff4f815b8c0 0x7ff4f80b6890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36768/0 (socket says 172.21.15.27:36768) 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4f5d9b640 1 -- 172.21.15.27:0/1531025501 learned_addr learned my addr 172.21.15.27:0/1531025501 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.485+0000 7ff4f659c640 1 --2- 172.21.15.27:0/1531025501 >> v2:172.21.15.27:3300/0 conn(0x7ff4f806ee70 0x7ff4f815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.489+0000 7ff4f659c640 1 -- 172.21.15.27:0/1531025501 >> v1:172.21.15.124:6789/0 conn(0x7ff4f80b7f40 legacy=0x7ff4f80b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.489+0000 7ff4f659c640 1 -- 172.21.15.27:0/1531025501 >> v1:172.21.15.27:6789/0 conn(0x7ff4f815b8c0 legacy=0x7ff4f80b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:15.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.489+0000 7ff4f659c640 1 -- 172.21.15.27:0/1531025501 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80bc5a0 con 0x7ff4f806ee70 2024-01-24T14:01:15.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.493+0000 7ff4f659c640 1 --2- 172.21.15.27:0/1531025501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f806ee70 0x7ff4f815b380 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00097a0 tx=0x7ff4f0020ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e7a734fd8a45c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4f559a640 1 -- 172.21.15.27:0/1531025501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00a9c20 con 0x7ff4f806ee70 2024-01-24T14:01:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4f559a640 1 -- 172.21.15.27:0/1531025501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00a9d80 con 0x7ff4f806ee70 2024-01-24T14:01:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4f559a640 1 -- 172.21.15.27:0/1531025501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00092f0 con 0x7ff4f806ee70 2024-01-24T14:01:15.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 -- 172.21.15.27:0/1531025501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f806ee70 msgr2=0x7ff4f815b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 --2- 172.21.15.27:0/1531025501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f806ee70 0x7ff4f815b380 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00097a0 tx=0x7ff4f0020ab0 comp rx=0 tx=0).stop 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 -- 172.21.15.27:0/1531025501 shutdown_connections 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 --2- 172.21.15.27:0/1531025501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f806ee70 0x7ff4f815b380 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 -- 172.21.15.27:0/1531025501 >> 172.21.15.27:0/1531025501 conn(0x7ff4f8069d20 msgr2=0x7ff4f806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 -- 172.21.15.27:0/1531025501 shutdown_connections 2024-01-24T14:01:15.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.517+0000 7ff4fca89640 1 -- 172.21.15.27:0/1531025501 wait complete. 2024-01-24T14:01:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 Processor -- start 2024-01-24T14:01:15.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 -- start start 2024-01-24T14:01:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f806ee70 0x7ff4f815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:15.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f815b8c0 0x7ff4f81e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f815aa20 con 0x7ff4f815b8c0 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f0090 con 0x7ff4f806ee70 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4fca89640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81e12f0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.124:3301/0 says I am v2:172.21.15.27:35580/0 (socket says 172.21.15.27:35580) 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 -- 172.21.15.27:0/989359733 learned_addr learned my addr 172.21.15.27:0/989359733 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f6d9d640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f815b8c0 0x7ff4f81e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:15.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f659c640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f806ee70 0x7ff4f815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 -- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f806ee70 msgr2=0x7ff4f815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f806ee70 0x7ff4f815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 -- 172.21.15.27:0/989359733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f815b8c0 msgr2=0x7ff4f81e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f815b8c0 0x7ff4f81e1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 -- 172.21.15.27:0/989359733 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009a80 con 0x7ff4f80b7f40 2024-01-24T14:01:15.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.521+0000 7ff4f5d9b640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009eb0 tx=0x7ff4e800c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:15.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80078f0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8007a50 con 0x7ff4f80b7f40 2024-01-24T14:01:15.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8007de0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81e27c0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81e15a0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4e8009070 con 0x7ff4f80b7f40 2024-01-24T14:01:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 0x7ff4e00680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4e8084be0 con 0x7ff4f80b7f40 2024-01-24T14:01:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.545+0000 7ff4f659c640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 0x7ff4e00680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:15.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.549+0000 7ff4f659c640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 0x7ff4e00680d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8089310 tx=0x7ff4f00ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:15.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.557+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f804e000 con 0x7ff4f80b7f40 2024-01-24T14:01:15.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:15.565+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7ff4e8019080 con 0x7ff4f80b7f40 2024-01-24T14:01:16.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.157+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7ff4f80b28e0 con 0x7ff4f80b7f40 2024-01-24T14:01:16.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4e6ffd640 1 -- 172.21.15.27:0/989359733 <== mon.2 v2:172.21.15.124:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v2367) v1 ==== 163+0+0 (secure 0 0 0) 0x7ff4e8052ac0 con 0x7ff4f80b7f40 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 msgr2=0x7ff4e00680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 0x7ff4e00680d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8089310 tx=0x7ff4f00ab070 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 msgr2=0x7ff4f81f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009eb0 tx=0x7ff4e800c430 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 shutdown_connections 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7ff4e0065c10 0x7ff4e00680d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4f815b8c0 0x7ff4f81e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7ff4f80b7f40 0x7ff4f81f0850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 --2- 172.21.15.27:0/989359733 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7ff4f806ee70 0x7ff4f815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 >> 172.21.15.27:0/989359733 conn(0x7ff4f8069d20 msgr2=0x7ff4f8156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:16.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 shutdown_connections 2024-01-24T14:01:16.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:16.889+0000 7ff4fca89640 1 -- 172.21.15.27:0/989359733 wait complete. 2024-01-24T14:01:16.917 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2024-01-24T14:01:16.917 INFO:tasks.cephfs_test_runner: 2024-01-24T14:01:16.917 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner: 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:Ran 1 test in 4601.030s 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner: 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner: 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-24T14:01:16.918 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-24T14:01:16.919 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-24T14:01:16.919 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2024-01-24T14:01:16.919 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-01-24T14:01:16.919 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-01-24T14:01:16.919 INFO:tasks.cephfs_test_runner: 2024-01-24T14:01:16.919 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-24T14:01:17.158 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=223e4bec483243ca804b5184215a73cc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-24T14:01:17.160 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-24T14:01:17.169 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-24T14:01:17.176 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-24T14:01:17.177 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-01-24T14:01:17.177 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-24T14:01:17.191 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354596k,nr_inodes=4088649,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3686 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-24T14:01:17.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:17.191 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-01-24T14:01:17.291 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-24T14:01:17.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:17.292 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-24T14:01:17.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-24T14:01:17.315 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-01-24T14:01:17.552 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-24T14:01:17.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-24T14:01:17.561 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T14:01:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.665+0000 7fe836976640 1 Processor -- start 2024-01-24T14:01:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.665+0000 7fe836976640 1 -- start start 2024-01-24T14:01:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.665+0000 7fe836976640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe830144b60 0x7fe8300658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe836976640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe830155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe836976640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe830065f50 con 0x7fe83006a840 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe836976640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe830071000 con 0x7fe830144b60 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe836976640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830071cf0 con 0x7fe83006acd0 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe83006a840 0x7fe83014e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36772/0 (socket says 172.21.15.27:36772) 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 -- 172.21.15.27:0/1687505387 learned_addr learned my addr 172.21.15.27:0/1687505387 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365476966 0 0) 0x7fe824001120 con 0x7fe83006a840 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82ffff640 1 --2- 172.21.15.27:0/1687505387 >> v2:172.21.15.124:3300/0 conn(0x7fe830144b60 0x7fe8300658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe834f13640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe830155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe818003530 con 0x7fe83006a840 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1240163318 0 0) 0x7fe818003530 con 0x7fe83006a840 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 msgr2=0x7fe830155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe830155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 >> v2:172.21.15.124:3300/0 conn(0x7fe830144b60 msgr2=0x7fe8300658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 --2- 172.21.15.27:0/1687505387 >> v2:172.21.15.124:3300/0 conn(0x7fe830144b60 0x7fe8300658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830070760 con 0x7fe83006a840 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fe824001810 con 0x7fe83006a840 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 >> v1:172.21.15.27:6789/0 conn(0x7fe83006a840 legacy=0x7fe83014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe818003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe818003f00 0x7fe8180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818004d10 0x7fe818005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830071000 con 0x7fe818003f00 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830071cf0 con 0x7fe818004d10 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81800b9e0 con 0x7fe83006acd0 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe818003f00 0x7fe8180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 -- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 msgr2=0x7fe818003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82ffff640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe818003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe834f13640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818004d10 0x7fe818005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe83006acd0 0x7fe818003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 -- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818004d10 msgr2=0x7fe818005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818004d10 0x7fe818005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 -- 172.21.15.27:0/1687505387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818003530 con 0x7fe818003f00 2024-01-24T14:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe834f13640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818004d10 0x7fe818005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:17.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82f7fe640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe818003f00 0x7fe8180047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c240 tx=0x7fe82401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b71b897c069d47 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:17.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240058e0 con 0x7fe818003f00 2024-01-24T14:01:17.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824005a40 con 0x7fe818003f00 2024-01-24T14:01:17.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.669+0000 7fe82effd640 1 -- 172.21.15.27:0/1687505387 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824005df0 con 0x7fe818003f00 2024-01-24T14:01:17.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/1687505387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe818003f00 msgr2=0x7fe8180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 --2- 172.21.15.27:0/1687505387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe818003f00 0x7fe8180047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe82400c240 tx=0x7fe82401cbf0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 -- 172.21.15.27:0/1687505387 reap_dead start 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/1687505387 shutdown_connections 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/1687505387 >> 172.21.15.27:0/1687505387 conn(0x7fe830069d20 msgr2=0x7fe83006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/1687505387 shutdown_connections 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/1687505387 wait complete. 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 Processor -- start 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- start start 2024-01-24T14:01:17.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818003f00 0x7fe8301e3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe830135ad0 0x7fe830138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830139e00 con 0x7fe830133930 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8301385e0 con 0x7fe818003f00 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83014dac0 con 0x7fe830135ad0 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39320/0 (socket says 172.21.15.27:39320) 2024-01-24T14:01:17.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 -- 172.21.15.27:0/2874043285 learned_addr learned my addr 172.21.15.27:0/2874043285 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe82ffff640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818003f00 0x7fe8301e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe82f7fe640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe830135ad0 0x7fe830138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 -- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe830135ad0 msgr2=0x7fe830138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe830135ad0 0x7fe830138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 -- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818003f00 msgr2=0x7fe8301e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818003f00 0x7fe8301e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 -- 172.21.15.27:0/2874043285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8301342f0 con 0x7fe830133930 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe834f13640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe83006b100 tx=0x7fe82800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:17.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828017400 con 0x7fe830133930 2024-01-24T14:01:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828011040 con 0x7fe830133930 2024-01-24T14:01:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe830138fb0 con 0x7fe830133930 2024-01-24T14:01:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8280177a0 con 0x7fe830133930 2024-01-24T14:01:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.673+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83014dd20 con 0x7fe830133930 2024-01-24T14:01:17.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83004e000 con 0x7fe830133930 2024-01-24T14:01:17.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8280163a0 con 0x7fe830133930 2024-01-24T14:01:17.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe82cff9640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 0x7fe81c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:17.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe828082eb0 con 0x7fe830133930 2024-01-24T14:01:17.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe82ffff640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 0x7fe81c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:17.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.677+0000 7fe82ffff640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 0x7fe81c067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe820009ab0 tx=0x7fe820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:17.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.685+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe828050b50 con 0x7fe830133930 2024-01-24T14:01:17.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.933+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe830144f40 con 0x7fe81c065a60 2024-01-24T14:01:17.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.941+0000 7fe82cff9640 1 -- 172.21.15.27:0/2874043285 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49616 (secure 0 0 0) 0x7fe8200129b0 con 0x7fe81c065a60 2024-01-24T14:01:17.944 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:17.945 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 msgr2=0x7fe81c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 0x7fe81c067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe820009ab0 tx=0x7fe820008040 comp rx=0 tx=0).stop 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 msgr2=0x7fe830133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe83006b100 tx=0x7fe82800f4a0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 shutdown_connections 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe81c065a60 0x7fe81c067f20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe830133930 0x7fe830133db0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe830135ad0 0x7fe830138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 --2- 172.21.15.27:0/2874043285 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe818003f00 0x7fe8301e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 >> 172.21.15.27:0/2874043285 conn(0x7fe830069d20 msgr2=0x7fe83013ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 shutdown_connections 2024-01-24T14:01:17.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:17.945+0000 7fe836976640 1 -- 172.21.15.27:0/2874043285 wait complete. 2024-01-24T14:01:17.961 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":2345,"stamp":"2024-01-24T14:01:17.247692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":10019472,"kb_used_data":423988,"kb_used_omap":13,"kb_used_meta":9595378,"kb_avail":744955248,"statfs":{"total":773094113280,"available":762834173952,"internally_reserved":0,"allocated":434163712,"data_stored":432266023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9825667160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1038,"apply_latency_ms":1038,"commit_latency_ns":1038000000,"apply_latency_ns":1038000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-752972243,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-56677,"num_read_kb":-53397161,"num_write":-1473778,"num_write_kb":-59617511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.675175"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T13:58:14.924787+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T13:58:14.924787+0000","last_peered":"2024-01-24T13:58:14.924787+0000","last_clean":"2024-01-24T13:58:14.924787+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T13:58:14.924787+0000","last_undegraded":"2024-01-24T13:58:14.924787+0000","last_fullsized":"2024-01-24T13:58:14.924787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575777,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1391240,"kb_used_data":164544,"kb_used_omap":1,"kb_used_meta":1226686,"kb_avail":92980600,"statfs":{"total":96636764160,"available":95212134400,"internally_reserved":0,"allocated":168493056,"data_stored":168268735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1256126731},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2270000000000001,"5min":1.4410000000000001,"15min":8.1880000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.88100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.141,"5min":1.3240000000000001,"15min":8.1460000000000008},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.99099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.327,"5min":3.327,"15min":24.010000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.82899999999999996,"15min":0.88600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.302,"15min":4.4950000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46600000000000003},"max":{"1min":1.0740000000000001,"5min":1.2410000000000001,"15min":7.202},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88500000000000001,"15min":0.93000000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":3.879},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.98999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1739999999999999,"5min":1.3220000000000001,"15min":14.164999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97599999999999998,"15min":1.0389999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.23,"5min":1.3009999999999999,"15min":13.304},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.93799999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.5900000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0029999999999999,"15min":0.98699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42699999999999999},"max":{"1min":1.294,"5min":1.3999999999999999,"15min":1.677},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0840000000000001,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.486,"5min":1.524,"15min":9.6890000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.5009999999999999,"15min":9.5440000000000005},"last":0.749}]},{"osd":6,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.1359999999999999,"15min":1.1160000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.359,"5min":1.502,"15min":1.7050000000000001},"last":1.026},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.151,"15min":1.109},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.85599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575779,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":898320,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":897918,"kb_avail":93473520,"statfs":{"total":96636764160,"available":95716884480,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":919468299},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":118,"apply_latency_ms":118,"commit_latency_ns":118000000,"apply_latency_ns":118000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.85399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":1.883,"5min":1.883,"15min":10.903},"last":1.883},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0979999999999999,"5min":4.7750000000000004,"15min":6.8630000000000004},"last":3.0979999999999999}]},{"osd":1,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.97399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.054,"5min":5.0369999999999999,"15min":29.503},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84699999999999998,"15min":0.98399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":3.9430000000000001,"15min":25.587},"last":1.9370000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":1.161},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":82.552000000000007},"last":2.0049999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94499999999999995,"15min":0.98999999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33900000000000002},"max":{"1min":1.163,"5min":4.9100000000000001,"15min":9.0719999999999992},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":1.1699999999999999,"5min":4.8520000000000003,"15min":13.555999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.90100000000000002,"15min":1.042},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":5.0609999999999999,"15min":13.352},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.0369999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":13.413},"last":2.0350000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.069,"15min":1.2090000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":1.3660000000000001,"5min":4.8810000000000002,"15min":39.143999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.0349999999999999,"15min":1.0529999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3879999999999999,"5min":4.9829999999999997,"15min":13.305},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.1060000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":11.635999999999999},"last":1.9710000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":1.4370000000000001,"5min":4.8209999999999997,"15min":7.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.877,"5min":1.0760000000000001,"15min":1.133},"min":{"1min":0.438,"5min":0.438,"15min":0.39700000000000002},"max":{"1min":1.27,"5min":5.0119999999999996,"15min":13.388},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834575780,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1285388,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1284990,"kb_avail":93086452,"statfs":{"total":96636764160,"available":95320526848,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1315830027},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":199,"apply_latency_ms":199,"commit_latency_ns":199000000,"apply_latency_ns":199000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.218},"max":{"1min":1.302,"5min":1.302,"15min":3.0760000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86299999999999999,"15min":0.83699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.7629999999999999,"5min":5.7629999999999999,"15min":5.7629999999999999},"last":0.372}]},{"osd":1,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":6.8849999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.212,"5min":0.92700000000000005,"15min":0.93200000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.96699999999999997,"15min":0.91600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32200000000000001},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.49299999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.91400000000000003,"15min":0.94199999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.508,"5min":1.508,"15min":3.169},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.0529999999999999,"15min":1.01},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.611,"5min":1.611,"15min":9.9760000000000009},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.099,"15min":1.056},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.7469999999999999,"5min":3.7469999999999999,"15min":3.7469999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1220000000000001,"15min":1.085},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.436}]},{"osd":7,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.115,"15min":1.139},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5389999999999999,"5min":1.5900000000000001,"15min":7.0700000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2010000000000001,"15min":1.1719999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575777,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774448,"kb_used_data":248360,"kb_used_omap":1,"kb_used_meta":1526078,"kb_avail":92597392,"statfs":{"total":96636764160,"available":94819729408,"internally_reserved":0,"allocated":254320640,"data_stored":254098654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1562704139},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80600000000000005,"15min":0.86299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":10.195},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":5.2400000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.87},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":10.234999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.85399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.35399999999999998},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.92200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":1.248,"5min":1.248,"15min":10.255000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.258,"5min":1.258,"15min":6.0579999999999998},"last":0.874},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93300000000000005,"15min":0.97799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":5.9020000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.27100000000000002},"max":{"1min":6.4649999999999999,"5min":6.4649999999999999,"15min":10.4},"last":1.028},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.488,"5min":1.488,"15min":5.3630000000000004},"last":0.997}]},{"osd":6,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1,"15min":1.0049999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.071,"15min":1.0980000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":10.462},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.5759999999999996,"5min":6.5759999999999996,"15min":6.5759999999999996},"last":1.1299999999999999},{"interface":"front","average":{"1min":1,"5min":1.0860000000000001,"15min":1.101},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.33100000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2789999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575779,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1285716,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1285310,"kb_avail":93086124,"statfs":{"total":96636764160,"available":95320190976,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1316157707},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":154,"apply_latency_ms":154,"commit_latency_ns":154000000,"apply_latency_ns":154000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58899999999999997,"15min":0.64800000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.191},"max":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":2.9860000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.63400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.22500000000000001},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.276},"last":0.69399999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.3620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68500000000000005,"15min":0.77600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.22700000000000001},"max":{"1min":1.04,"5min":1.3320000000000001,"15min":11.891},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.79400000000000004},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0640000000000001,"5min":1.3859999999999999,"15min":4.8230000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.86799999999999999},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":1.2689999999999999,"15min":4.9349999999999996},"last":0.89000000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.999,"15min":1},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":3.4529999999999998,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":0.98899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":1.482,"5min":1.585,"15min":1.6080000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.98899999999999999,"15min":1.2789999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4650000000000001,"5min":1.714,"15min":57.396999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.02,"15min":1.1299999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42099999999999999},"max":{"1min":1.1879999999999999,"5min":2.54,"15min":25.677},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.018,"15min":1.137},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.7809999999999999,"15min":21.785},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"max":{"1min":1.5229999999999999,"5min":1.804,"15min":2.7949999999999999},"last":1.0609999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.042,"15min":1.1539999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.25,"5min":1.5509999999999999,"15min":12.884},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.1479999999999999},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.397,"5min":1.665,"15min":5.3209999999999997},"last":1.29}]}]},{"osd":2,"up_from":13,"seq":55834575777,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":992908,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":992510,"kb_avail":93378932,"statfs":{"total":96636764160,"available":95620026368,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1016330507},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":205,"apply_latency_ms":205,"commit_latency_ns":205000000,"apply_latency_ns":205000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64300000000000002,"15min":0.83399999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.018,"5min":1.696,"15min":39.767000000000003},"last":3.4470000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.76000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.223},"max":{"1min":2.516,"5min":2.516,"15min":11.352},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.755},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":1.2689999999999999,"5min":1.3240000000000001,"15min":2.3140000000000001},"last":3.4969999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.755,"15min":0.86099999999999999},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":13.101000000000001},"last":0.373}]},{"osd":3,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.79600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.26000000000000001},"max":{"1min":1.0149999999999999,"5min":1.7370000000000001,"15min":7.1710000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.90900000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":1.069,"5min":1.887,"15min":6.891},"last":3.4729999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.681,"5min":3.681,"15min":5.0899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":0.96499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.313},"max":{"1min":1.3149999999999999,"5min":1.5249999999999999,"15min":4.5869999999999997},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.054,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.5620000000000001,"15min":8.4190000000000005},"last":9.2469999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.091,"15min":1.1319999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.7549999999999999,"5min":3.7549999999999999,"15min":4.577},"last":9.1809999999999992}]},{"osd":6,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98199999999999998,"15min":1.0640000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.39400000000000002},"max":{"1min":1.534,"5min":1.792,"15min":5.859},"last":0.628},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0700000000000001,"15min":1.179},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45700000000000002},"max":{"1min":1.667,"5min":1.667,"15min":13.824},"last":3.4129999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.147,"15min":1.1639999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.002,"15min":1.099},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.36699999999999999},"max":{"1min":1.619,"5min":1.619,"15min":4.6580000000000004},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575778,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1502288,"kb_used_data":8584,"kb_used_omap":1,"kb_used_meta":1493694,"kb_avail":92869552,"statfs":{"total":96636764160,"available":95098421248,"internally_reserved":0,"allocated":8790016,"data_stored":8548711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1529542923},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":159,"apply_latency_ms":159,"commit_latency_ns":159000000,"apply_latency_ns":159000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63800000000000001,"15min":0.749},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":25.135999999999999},"last":5.9740000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.64000000000000001,"15min":0.754},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.601,"5min":2.601,"15min":25.262},"last":6.0999999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63600000000000001,"15min":0.67800000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.3,"5min":1.478,"15min":3.6139999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.679,"5min":1.679,"15min":4.8259999999999996},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.931,"5min":1.931,"15min":5.4850000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.28399999999999997},"max":{"1min":1.4450000000000001,"5min":1.7769999999999999,"15min":7.9800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.073},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":4.8710000000000004},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":4.3810000000000002,"5min":1.7130000000000001,"15min":1.337},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.41399999999999998},"max":{"1min":74.188000000000002,"5min":74.188000000000002,"15min":74.188000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.71,"15min":1.3260000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":74.143000000000001,"5min":74.143000000000001,"15min":74.143000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.1759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.373},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":16.021999999999998},"last":0.44},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39000000000000001},"max":{"1min":1.522,"5min":1.804,"15min":7.6950000000000003},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.141,"15min":1.1779999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.8600000000000003},"last":2.3809999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.1200000000000001,"15min":1.234},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44700000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":16.082000000000001},"last":0.51100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575780,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889164,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":888190,"kb_avail":93482676,"statfs":{"total":96636764160,"available":95726260224,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":909506827},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":203,"apply_latency_ms":203,"commit_latency_ns":203000000,"apply_latency_ns":203000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.65200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2869999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.032,"5min":1.26,"15min":1.3899999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.72099999999999997},"min":{"1min":0.35099999999999998,"5min":0.27100000000000002,"15min":0.222},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.585},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98099999999999998,"5min":1.083,"15min":6.399},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":18.024999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.86799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.173,"5min":1.194,"15min":1.5289999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94899999999999995,"15min":1.0149999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.454,"5min":1.5489999999999999,"15min":6.3499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2869999999999999,"5min":1.3700000000000001,"15min":1.593},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89900000000000002,"15min":0.94799999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.587},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.9930000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.143},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.371},"max":{"1min":1.651,"5min":1.651,"15min":2.101},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.1220000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.45,"15min":6.3109999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0249999999999999,"15min":1.113},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.415,"5min":1.6140000000000001,"15min":6.3760000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":1.0529999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3700000000000001,"5min":1.4990000000000001,"15min":1.6699999999999999},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T14:01:17.963 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T14:01:18.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.065+0000 7f05a3341640 1 Processor -- start 2024-01-24T14:01:18.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.065+0000 7f05a3341640 1 -- start start 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a3341640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f059c0b6880 0x7f059c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a3341640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b9270 0x7f059c142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a3341640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c06fed0 con 0x7f059c142bc0 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a3341640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0b8de0 con 0x7f059c0b6880 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a3341640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b8ae0 con 0x7f059c0b9270 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f059c0b6880 0x7f059c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f059c0b6880 0x7f059c14bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39324/0 (socket says 172.21.15.27:39324) 2024-01-24T14:01:18.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 -- 172.21.15.27:0/3772305559 learned_addr learned my addr 172.21.15.27:0/3772305559 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 -- 172.21.15.27:0/3772305559 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b9270 msgr2=0x7f059c142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 --2- 172.21.15.27:0/3772305559 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b9270 0x7f059c142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 -- 172.21.15.27:0/3772305559 >> v1:172.21.15.124:6789/0 conn(0x7f059c142bc0 legacy=0x7f059c069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 -- 172.21.15.27:0/3772305559 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0b7d30 con 0x7f059c0b6880 2024-01-24T14:01:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f05a10dd640 1 --2- 172.21.15.27:0/3772305559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c0b6880 0x7f059c14bcf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a15ff1f2bf4f57 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f0593fff640 1 -- 172.21.15.27:0/3772305559 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980aa640 con 0x7f059c0b6880 2024-01-24T14:01:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f0593fff640 1 -- 172.21.15.27:0/3772305559 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980aa7a0 con 0x7f059c0b6880 2024-01-24T14:01:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.069+0000 7f0593fff640 1 -- 172.21.15.27:0/3772305559 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980aab30 con 0x7f059c0b6880 2024-01-24T14:01:18.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/3772305559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c0b6880 msgr2=0x7f059c14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- 172.21.15.27:0/3772305559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c0b6880 0x7f059c14bcf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059801c500 comp rx=0 tx=0).stop 2024-01-24T14:01:18.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/3772305559 shutdown_connections 2024-01-24T14:01:18.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- 172.21.15.27:0/3772305559 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b9270 0x7f059c142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- 172.21.15.27:0/3772305559 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c0b6880 0x7f059c14bcf0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/3772305559 >> 172.21.15.27:0/3772305559 conn(0x7f059c06ae30 msgr2=0x7f059c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/3772305559 shutdown_connections 2024-01-24T14:01:18.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/3772305559 wait complete. 2024-01-24T14:01:18.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 Processor -- start 2024-01-24T14:01:18.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- start start 2024-01-24T14:01:18.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b6880 0x7f059c132420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f059c1e4010 0x7f059c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c132960 con 0x7f059c142bc0 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1e44c0 con 0x7f059c1e4010 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b5da0 con 0x7f059c0b6880 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39340/0 (socket says 172.21.15.27:39340) 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 -- 172.21.15.27:0/2751930183 learned_addr learned my addr 172.21.15.27:0/2751930183 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a18de640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f059c1e4010 0x7f059c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 -- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b6880 msgr2=0x7f059c132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a10dd640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b6880 0x7f059c132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b6880 0x7f059c132420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 -- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f059c1e4010 msgr2=0x7f059c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f059c1e4010 0x7f059c0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 -- 172.21.15.27:0/2751930183 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980094d0 con 0x7f059c142bc0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a08dc640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b580 tx=0x7f058c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c010870 con 0x7f059c142bc0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c0109f0 con 0x7f059c142bc0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c010da0 con 0x7f059c142bc0 2024-01-24T14:01:18.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c14c3b0 con 0x7f059c142bc0 2024-01-24T14:01:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0b4a50 con 0x7f059c142bc0 2024-01-24T14:01:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.073+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c04e000 con 0x7f059c142bc0 2024-01-24T14:01:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.077+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f058c00f3c0 con 0x7f059c142bc0 2024-01-24T14:01:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.077+0000 7f0591ffb640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 0x7f0580067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.077+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f058c082e00 con 0x7f059c142bc0 2024-01-24T14:01:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.077+0000 7f05a10dd640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 0x7f0580067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.077+0000 7f05a10dd640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 0x7f0580067f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05980ae000 tx=0x7f0598008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.085+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f058c050ad0 con 0x7f059c142bc0 2024-01-24T14:01:18.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.233+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f059c14c230 con 0x7f0580065a90 2024-01-24T14:01:18.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.237+0000 7f0591ffb640 1 -- 172.21.15.27:0/2751930183 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49616 (secure 0 0 0) 0x7f05980ba090 con 0x7f0580065a90 2024-01-24T14:01:18.241 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:18.242 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 msgr2=0x7f0580067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 0x7f0580067f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05980ae000 tx=0x7f0598008040 comp rx=0 tx=0).stop 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 msgr2=0x7f059c1e3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b580 tx=0x7f058c00ba40 comp rx=0 tx=0).stop 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 shutdown_connections 2024-01-24T14:01:18.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0580065a90 0x7f0580067f50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f059c1e4010 0x7f059c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f059c142bc0 0x7f059c1e3ad0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 --2- 172.21.15.27:0/2751930183 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f059c0b6880 0x7f059c132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 >> 172.21.15.27:0/2751930183 conn(0x7f059c06ae30 msgr2=0x7f059c073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 shutdown_connections 2024-01-24T14:01:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.241+0000 7f05a3341640 1 -- 172.21.15.27:0/2751930183 wait complete. 2024-01-24T14:01:18.260 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":2345,"stamp":"2024-01-24T14:01:17.247692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":10019472,"kb_used_data":423988,"kb_used_omap":13,"kb_used_meta":9595378,"kb_avail":744955248,"statfs":{"total":773094113280,"available":762834173952,"internally_reserved":0,"allocated":434163712,"data_stored":432266023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9825667160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1038,"apply_latency_ms":1038,"commit_latency_ns":1038000000,"apply_latency_ns":1038000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-752972243,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-56677,"num_read_kb":-53397161,"num_write":-1473778,"num_write_kb":-59617511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.675175"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T13:58:14.924787+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T13:58:14.924787+0000","last_peered":"2024-01-24T13:58:14.924787+0000","last_clean":"2024-01-24T13:58:14.924787+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T13:58:14.924787+0000","last_undegraded":"2024-01-24T13:58:14.924787+0000","last_fullsized":"2024-01-24T13:58:14.924787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575777,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1391240,"kb_used_data":164544,"kb_used_omap":1,"kb_used_meta":1226686,"kb_avail":92980600,"statfs":{"total":96636764160,"available":95212134400,"internally_reserved":0,"allocated":168493056,"data_stored":168268735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1256126731},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2270000000000001,"5min":1.4410000000000001,"15min":8.1880000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.88100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.141,"5min":1.3240000000000001,"15min":8.1460000000000008},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.99099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.327,"5min":3.327,"15min":24.010000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.82899999999999996,"15min":0.88600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.302,"15min":4.4950000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46600000000000003},"max":{"1min":1.0740000000000001,"5min":1.2410000000000001,"15min":7.202},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88500000000000001,"15min":0.93000000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":3.879},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.98999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1739999999999999,"5min":1.3220000000000001,"15min":14.164999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97599999999999998,"15min":1.0389999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.23,"5min":1.3009999999999999,"15min":13.304},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.93799999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.5900000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0029999999999999,"15min":0.98699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42699999999999999},"max":{"1min":1.294,"5min":1.3999999999999999,"15min":1.677},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0840000000000001,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.486,"5min":1.524,"15min":9.6890000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.5009999999999999,"15min":9.5440000000000005},"last":0.749}]},{"osd":6,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.1359999999999999,"15min":1.1160000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.359,"5min":1.502,"15min":1.7050000000000001},"last":1.026},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.151,"15min":1.109},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.85599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575779,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":898320,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":897918,"kb_avail":93473520,"statfs":{"total":96636764160,"available":95716884480,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":919468299},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":118,"apply_latency_ms":118,"commit_latency_ns":118000000,"apply_latency_ns":118000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.85399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":1.883,"5min":1.883,"15min":10.903},"last":1.883},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0979999999999999,"5min":4.7750000000000004,"15min":6.8630000000000004},"last":3.0979999999999999}]},{"osd":1,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.97399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.054,"5min":5.0369999999999999,"15min":29.503},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84699999999999998,"15min":0.98399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":3.9430000000000001,"15min":25.587},"last":1.9370000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":1.161},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":82.552000000000007},"last":2.0049999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94499999999999995,"15min":0.98999999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33900000000000002},"max":{"1min":1.163,"5min":4.9100000000000001,"15min":9.0719999999999992},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":1.1699999999999999,"5min":4.8520000000000003,"15min":13.555999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.90100000000000002,"15min":1.042},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":5.0609999999999999,"15min":13.352},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.0369999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":13.413},"last":2.0350000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.069,"15min":1.2090000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":1.3660000000000001,"5min":4.8810000000000002,"15min":39.143999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.0349999999999999,"15min":1.0529999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3879999999999999,"5min":4.9829999999999997,"15min":13.305},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.1060000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":11.635999999999999},"last":1.9710000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":1.4370000000000001,"5min":4.8209999999999997,"15min":7.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.877,"5min":1.0760000000000001,"15min":1.133},"min":{"1min":0.438,"5min":0.438,"15min":0.39700000000000002},"max":{"1min":1.27,"5min":5.0119999999999996,"15min":13.388},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834575780,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1285388,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1284990,"kb_avail":93086452,"statfs":{"total":96636764160,"available":95320526848,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1315830027},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":199,"apply_latency_ms":199,"commit_latency_ns":199000000,"apply_latency_ns":199000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.218},"max":{"1min":1.302,"5min":1.302,"15min":3.0760000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86299999999999999,"15min":0.83699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.7629999999999999,"5min":5.7629999999999999,"15min":5.7629999999999999},"last":0.372}]},{"osd":1,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":6.8849999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.212,"5min":0.92700000000000005,"15min":0.93200000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.96699999999999997,"15min":0.91600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32200000000000001},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.49299999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.91400000000000003,"15min":0.94199999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.508,"5min":1.508,"15min":3.169},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.0529999999999999,"15min":1.01},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.611,"5min":1.611,"15min":9.9760000000000009},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.099,"15min":1.056},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.7469999999999999,"5min":3.7469999999999999,"15min":3.7469999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1220000000000001,"15min":1.085},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.436}]},{"osd":7,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.115,"15min":1.139},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5389999999999999,"5min":1.5900000000000001,"15min":7.0700000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2010000000000001,"15min":1.1719999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575777,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774448,"kb_used_data":248360,"kb_used_omap":1,"kb_used_meta":1526078,"kb_avail":92597392,"statfs":{"total":96636764160,"available":94819729408,"internally_reserved":0,"allocated":254320640,"data_stored":254098654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1562704139},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80600000000000005,"15min":0.86299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":10.195},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":5.2400000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.87},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":10.234999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.85399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.35399999999999998},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.92200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":1.248,"5min":1.248,"15min":10.255000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.258,"5min":1.258,"15min":6.0579999999999998},"last":0.874},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93300000000000005,"15min":0.97799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":5.9020000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.27100000000000002},"max":{"1min":6.4649999999999999,"5min":6.4649999999999999,"15min":10.4},"last":1.028},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.488,"5min":1.488,"15min":5.3630000000000004},"last":0.997}]},{"osd":6,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1,"15min":1.0049999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.071,"15min":1.0980000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":10.462},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.5759999999999996,"5min":6.5759999999999996,"15min":6.5759999999999996},"last":1.1299999999999999},{"interface":"front","average":{"1min":1,"5min":1.0860000000000001,"15min":1.101},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.33100000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2789999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575779,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1285716,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1285310,"kb_avail":93086124,"statfs":{"total":96636764160,"available":95320190976,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1316157707},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":154,"apply_latency_ms":154,"commit_latency_ns":154000000,"apply_latency_ns":154000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58899999999999997,"15min":0.64800000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.191},"max":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":2.9860000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.63400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.22500000000000001},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.276},"last":0.69399999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.3620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68500000000000005,"15min":0.77600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.22700000000000001},"max":{"1min":1.04,"5min":1.3320000000000001,"15min":11.891},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.79400000000000004},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0640000000000001,"5min":1.3859999999999999,"15min":4.8230000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.86799999999999999},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":1.2689999999999999,"15min":4.9349999999999996},"last":0.89000000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.999,"15min":1},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":3.4529999999999998,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":0.98899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":1.482,"5min":1.585,"15min":1.6080000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.98899999999999999,"15min":1.2789999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4650000000000001,"5min":1.714,"15min":57.396999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.02,"15min":1.1299999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42099999999999999},"max":{"1min":1.1879999999999999,"5min":2.54,"15min":25.677},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.018,"15min":1.137},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.7809999999999999,"15min":21.785},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"max":{"1min":1.5229999999999999,"5min":1.804,"15min":2.7949999999999999},"last":1.0609999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.042,"15min":1.1539999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.25,"5min":1.5509999999999999,"15min":12.884},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.1479999999999999},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.397,"5min":1.665,"15min":5.3209999999999997},"last":1.29}]}]},{"osd":2,"up_from":13,"seq":55834575777,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":992908,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":992510,"kb_avail":93378932,"statfs":{"total":96636764160,"available":95620026368,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1016330507},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":205,"apply_latency_ms":205,"commit_latency_ns":205000000,"apply_latency_ns":205000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64300000000000002,"15min":0.83399999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.018,"5min":1.696,"15min":39.767000000000003},"last":3.4470000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.76000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.223},"max":{"1min":2.516,"5min":2.516,"15min":11.352},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.755},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":1.2689999999999999,"5min":1.3240000000000001,"15min":2.3140000000000001},"last":3.4969999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.755,"15min":0.86099999999999999},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":13.101000000000001},"last":0.373}]},{"osd":3,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.79600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.26000000000000001},"max":{"1min":1.0149999999999999,"5min":1.7370000000000001,"15min":7.1710000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.90900000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":1.069,"5min":1.887,"15min":6.891},"last":3.4729999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.681,"5min":3.681,"15min":5.0899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":0.96499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.313},"max":{"1min":1.3149999999999999,"5min":1.5249999999999999,"15min":4.5869999999999997},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.054,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.5620000000000001,"15min":8.4190000000000005},"last":9.2469999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.091,"15min":1.1319999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.7549999999999999,"5min":3.7549999999999999,"15min":4.577},"last":9.1809999999999992}]},{"osd":6,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98199999999999998,"15min":1.0640000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.39400000000000002},"max":{"1min":1.534,"5min":1.792,"15min":5.859},"last":0.628},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0700000000000001,"15min":1.179},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45700000000000002},"max":{"1min":1.667,"5min":1.667,"15min":13.824},"last":3.4129999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.147,"15min":1.1639999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.002,"15min":1.099},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.36699999999999999},"max":{"1min":1.619,"5min":1.619,"15min":4.6580000000000004},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575778,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1502288,"kb_used_data":8584,"kb_used_omap":1,"kb_used_meta":1493694,"kb_avail":92869552,"statfs":{"total":96636764160,"available":95098421248,"internally_reserved":0,"allocated":8790016,"data_stored":8548711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1529542923},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":159,"apply_latency_ms":159,"commit_latency_ns":159000000,"apply_latency_ns":159000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63800000000000001,"15min":0.749},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":25.135999999999999},"last":5.9740000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.64000000000000001,"15min":0.754},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.601,"5min":2.601,"15min":25.262},"last":6.0999999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63600000000000001,"15min":0.67800000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.3,"5min":1.478,"15min":3.6139999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.679,"5min":1.679,"15min":4.8259999999999996},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.931,"5min":1.931,"15min":5.4850000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.28399999999999997},"max":{"1min":1.4450000000000001,"5min":1.7769999999999999,"15min":7.9800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.073},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":4.8710000000000004},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":4.3810000000000002,"5min":1.7130000000000001,"15min":1.337},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.41399999999999998},"max":{"1min":74.188000000000002,"5min":74.188000000000002,"15min":74.188000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.71,"15min":1.3260000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":74.143000000000001,"5min":74.143000000000001,"15min":74.143000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.1759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.373},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":16.021999999999998},"last":0.44},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39000000000000001},"max":{"1min":1.522,"5min":1.804,"15min":7.6950000000000003},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.141,"15min":1.1779999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.8600000000000003},"last":2.3809999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.1200000000000001,"15min":1.234},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44700000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":16.082000000000001},"last":0.51100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575780,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889164,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":888190,"kb_avail":93482676,"statfs":{"total":96636764160,"available":95726260224,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":909506827},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":203,"apply_latency_ms":203,"commit_latency_ns":203000000,"apply_latency_ns":203000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.65200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2869999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.032,"5min":1.26,"15min":1.3899999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.72099999999999997},"min":{"1min":0.35099999999999998,"5min":0.27100000000000002,"15min":0.222},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.585},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98099999999999998,"5min":1.083,"15min":6.399},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":18.024999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.86799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.173,"5min":1.194,"15min":1.5289999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94899999999999995,"15min":1.0149999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.454,"5min":1.5489999999999999,"15min":6.3499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2869999999999999,"5min":1.3700000000000001,"15min":1.593},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89900000000000002,"15min":0.94799999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.587},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.9930000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.143},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.371},"max":{"1min":1.651,"5min":1.651,"15min":2.101},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.1220000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.45,"15min":6.3109999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0249999999999999,"15min":1.113},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.415,"5min":1.6140000000000001,"15min":6.3760000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":1.0529999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3700000000000001,"5min":1.4990000000000001,"15min":1.6699999999999999},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T14:01:18.261 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-24T14:01:18.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T14:01:18.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 Processor -- start 2024-01-24T14:01:18.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 -- start start 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe7ac06c7c0 0x7fe7ac0b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac0b9b30 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac0710a0 con 0x7fe7ac0ba300 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7b17bd640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac071760 con 0x7fe7ac06c7c0 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe7ac0b9f20 0x7fe7ac06c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36780/0 (socket says 172.21.15.27:36780) 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 -- 172.21.15.27:0/2857675799 learned_addr learned my addr 172.21.15.27:0/2857675799 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216737740 0 0) 0x7fe79c001120 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7ab7fe640 1 --2- 172.21.15.27:0/2857675799 >> v2:172.21.15.124:3300/0 conn(0x7fe7ac06c7c0 0x7fe7ac0b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe794003530 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432632000 0 0) 0x7fe794003530 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 >> v2:172.21.15.124:3300/0 conn(0x7fe7ac06c7c0 msgr2=0x7fe7ac0b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 --2- 172.21.15.27:0/2857675799 >> v2:172.21.15.124:3300/0 conn(0x7fe7ac06c7c0 0x7fe7ac0b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 >> v1:172.21.15.124:6789/0 conn(0x7fe7ac0ba300 legacy=0x7fe7ac1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac071380 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fe79c001810 con 0x7fe7ac0b9f20 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 >> v1:172.21.15.27:6789/0 conn(0x7fe7ac0b9f20 legacy=0x7fe7ac06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 0x7fe794003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7940047d0 0x7fe794004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794005190 0x7fe79400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac071760 con 0x7fe794003980 2024-01-24T14:01:18.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79400c030 con 0x7fe7940047d0 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79400c1f0 con 0x7fe794005190 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 0x7fe794003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aa7fc640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7940047d0 0x7fe794004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7ab7fe640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794005190 0x7fe79400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 -- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794005190 msgr2=0x7fe79400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794005190 0x7fe79400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 -- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7940047d0 msgr2=0x7fe794004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7940047d0 0x7fe794004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7aaffd640 1 -- 172.21.15.27:0/2857675799 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794003530 con 0x7fe794003980 2024-01-24T14:01:18.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7ab7fe640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794005190 0x7fe79400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:18.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.377+0000 7fe7ab7fe640 1 -- 172.21.15.27:0/2857675799 reap_dead start 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 0x7fe794003da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c240 tx=0x7fe79c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6bd8db5d27cf63 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005ae0 con 0x7fe794003980 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c005c60 con 0x7fe794003980 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7a9ffb640 1 -- 172.21.15.27:0/2857675799 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0072b0 con 0x7fe794003980 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 msgr2=0x7fe794003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 0x7fe794003da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c240 tx=0x7fe79c01cb80 comp rx=0 tx=0).stop 2024-01-24T14:01:18.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/2857675799 shutdown_connections 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/2857675799 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe794003980 0x7fe794003da0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/2857675799 >> 172.21.15.27:0/2857675799 conn(0x7fe7ac0be150 msgr2=0x7fe7ac0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/2857675799 shutdown_connections 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/2857675799 wait complete. 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 Processor -- start 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- start start 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 0x7fe7ac14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7ac13c2d0 0x7fe7ac13c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac1d6ac0 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac14c780 con 0x7fe7ac13c2d0 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac14d870 con 0x7fe794003980 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39350/0 (socket says 172.21.15.27:39350) 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 -- 172.21.15.27:0/1214462231 learned_addr learned my addr 172.21.15.27:0/1214462231 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 0x7fe7ac14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 -- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 msgr2=0x7fe7ac14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 0x7fe7ac14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 -- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7ac13c2d0 msgr2=0x7fe7ac13c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7ab7fe640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7ac13c2d0 0x7fe7ac13c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7ac13c2d0 0x7fe7ac13c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 -- 172.21.15.27:0/1214462231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac1e4850 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 0x7fe7ac14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7aa7fc640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e510 tx=0x7fe7a000e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00052e0 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0005440 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac14dae0 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0003840 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.381+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac0bdd90 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac04e000 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7a00039a0 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7937fe640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 0x7fe798067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe7a0082830 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 0x7fe798067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.385+0000 7fe7aaffd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 0x7fe798067f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0ab000 tx=0x7fe79c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.389+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe7a0050580 con 0x7fe7ac1e3eb0 2024-01-24T14:01:18.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.537+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7ac0b9450 con 0x7fe798065a90 2024-01-24T14:01:18.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7937fe640 1 -- 172.21.15.27:0/1214462231 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49616 (secure 0 0 0) 0x7fe79c001610 con 0x7fe798065a90 2024-01-24T14:01:18.547 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:18.547 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T14:01:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 msgr2=0x7fe798067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 0x7fe798067f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0ab000 tx=0x7fe79c0a7070 comp rx=0 tx=0).stop 2024-01-24T14:01:18.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 msgr2=0x7fe7ac1e4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e510 tx=0x7fe7a000e9d0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 shutdown_connections 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe798065a90 0x7fe798067f50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe7ac13c2d0 0x7fe7ac13c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7ac1e3eb0 0x7fe7ac1e4310 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 --2- 172.21.15.27:0/1214462231 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe794003980 0x7fe7ac14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 >> 172.21.15.27:0/1214462231 conn(0x7fe7ac0be150 msgr2=0x7fe7ac1d9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 shutdown_connections 2024-01-24T14:01:18.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.545+0000 7fe7b17bd640 1 -- 172.21.15.27:0/1214462231 wait complete. 2024-01-24T14:01:18.566 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":2345,"stamp":"2024-01-24T14:01:17.247692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":10019472,"kb_used_data":423988,"kb_used_omap":13,"kb_used_meta":9595378,"kb_avail":744955248,"statfs":{"total":773094113280,"available":762834173952,"internally_reserved":0,"allocated":434163712,"data_stored":432266023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9825667160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1038,"apply_latency_ms":1038,"commit_latency_ns":1038000000,"apply_latency_ns":1038000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-752972243,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-56677,"num_read_kb":-53397161,"num_write":-1473778,"num_write_kb":-59617511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.675175"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-24T13:58:14.924787+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T13:58:14.924787+0000","last_peered":"2024-01-24T13:58:14.924787+0000","last_clean":"2024-01-24T13:58:14.924787+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T13:58:14.924787+0000","last_undegraded":"2024-01-24T13:58:14.924787+0000","last_fullsized":"2024-01-24T13:58:14.924787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575777,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1391240,"kb_used_data":164544,"kb_used_omap":1,"kb_used_meta":1226686,"kb_avail":92980600,"statfs":{"total":96636764160,"available":95212134400,"internally_reserved":0,"allocated":168493056,"data_stored":168268735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1256126731},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2270000000000001,"5min":1.4410000000000001,"15min":8.1880000000000006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.88100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.141,"5min":1.3240000000000001,"15min":8.1460000000000008},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.99099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.327,"5min":3.327,"15min":24.010000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.82899999999999996,"15min":0.88600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.302,"15min":4.4950000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46600000000000003},"max":{"1min":1.0740000000000001,"5min":1.2410000000000001,"15min":7.202},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88500000000000001,"15min":0.93000000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":3.879},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.98999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1739999999999999,"5min":1.3220000000000001,"15min":14.164999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97599999999999998,"15min":1.0389999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.23,"5min":1.3009999999999999,"15min":13.304},"last":1.0589999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.93799999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.5900000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0029999999999999,"15min":0.98699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42699999999999999},"max":{"1min":1.294,"5min":1.3999999999999999,"15min":1.677},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0840000000000001,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.486,"5min":1.524,"15min":9.6890000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.5009999999999999,"15min":9.5440000000000005},"last":0.749}]},{"osd":6,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.1359999999999999,"15min":1.1160000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.359,"5min":1.502,"15min":1.7050000000000001},"last":1.026},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.151,"15min":1.109},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.85599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575779,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":898320,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":897918,"kb_avail":93473520,"statfs":{"total":96636764160,"available":95716884480,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":919468299},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":118,"apply_latency_ms":118,"commit_latency_ns":118000000,"apply_latency_ns":118000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.85399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":1.883,"5min":1.883,"15min":10.903},"last":1.883},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0979999999999999,"5min":4.7750000000000004,"15min":6.8630000000000004},"last":3.0979999999999999}]},{"osd":1,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.97399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.054,"5min":5.0369999999999999,"15min":29.503},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84699999999999998,"15min":0.98399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":3.9430000000000001,"15min":25.587},"last":1.9370000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":1.161},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":82.552000000000007},"last":2.0049999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94499999999999995,"15min":0.98999999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33900000000000002},"max":{"1min":1.163,"5min":4.9100000000000001,"15min":9.0719999999999992},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":1.1699999999999999,"5min":4.8520000000000003,"15min":13.555999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.90100000000000002,"15min":1.042},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":5.0609999999999999,"15min":13.352},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.0369999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":13.413},"last":2.0350000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.069,"15min":1.2090000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":1.3660000000000001,"5min":4.8810000000000002,"15min":39.143999999999998},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.0349999999999999,"15min":1.0529999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3879999999999999,"5min":4.9829999999999997,"15min":13.305},"last":1.3879999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.1060000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":11.635999999999999},"last":1.9710000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":1.4370000000000001,"5min":4.8209999999999997,"15min":7.1779999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.877,"5min":1.0760000000000001,"15min":1.133},"min":{"1min":0.438,"5min":0.438,"15min":0.39700000000000002},"max":{"1min":1.27,"5min":5.0119999999999996,"15min":13.388},"last":1.016}]}]},{"osd":5,"up_from":13,"seq":55834575780,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1285388,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1284990,"kb_avail":93086452,"statfs":{"total":96636764160,"available":95320526848,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1315830027},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":199,"apply_latency_ms":199,"commit_latency_ns":199000000,"apply_latency_ns":199000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.218},"max":{"1min":1.302,"5min":1.302,"15min":3.0760000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86299999999999999,"15min":0.83699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.7629999999999999,"5min":5.7629999999999999,"15min":5.7629999999999999},"last":0.372}]},{"osd":1,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":6.8849999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.212,"5min":0.92700000000000005,"15min":0.93200000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.96699999999999997,"15min":0.91600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32200000000000001},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.49299999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.91400000000000003,"15min":0.94199999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.508,"5min":1.508,"15min":3.169},"last":0.40999999999999998},{"interface":"front","average":{"1min":1.254,"5min":1.0529999999999999,"15min":1.01},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.611,"5min":1.611,"15min":9.9760000000000009},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.099,"15min":1.056},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.7469999999999999,"5min":3.7469999999999999,"15min":3.7469999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1220000000000001,"15min":1.085},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.436}]},{"osd":7,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.115,"15min":1.139},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5389999999999999,"5min":1.5900000000000001,"15min":7.0700000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2010000000000001,"15min":1.1719999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575777,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1774448,"kb_used_data":248360,"kb_used_omap":1,"kb_used_meta":1526078,"kb_avail":92597392,"statfs":{"total":96636764160,"available":94819729408,"internally_reserved":0,"allocated":254320640,"data_stored":254098654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1562704139},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80600000000000005,"15min":0.86299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":10.195},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":5.2400000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.87},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":10.234999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.85399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.35399999999999998},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.92200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":1.248,"5min":1.248,"15min":10.255000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.258,"5min":1.258,"15min":6.0579999999999998},"last":0.874},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93300000000000005,"15min":0.97799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":5.9020000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.27100000000000002},"max":{"1min":6.4649999999999999,"5min":6.4649999999999999,"15min":10.4},"last":1.028},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.488,"5min":1.488,"15min":5.3630000000000004},"last":0.997}]},{"osd":6,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1,"15min":1.0049999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.071,"15min":1.0980000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":10.462},"last":1.1599999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.5759999999999996,"5min":6.5759999999999996,"15min":6.5759999999999996},"last":1.1299999999999999},{"interface":"front","average":{"1min":1,"5min":1.0860000000000001,"15min":1.101},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.33100000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.2789999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575779,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1285716,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1285310,"kb_avail":93086124,"statfs":{"total":96636764160,"available":95320190976,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1316157707},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":154,"apply_latency_ms":154,"commit_latency_ns":154000000,"apply_latency_ns":154000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58899999999999997,"15min":0.64800000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.191},"max":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":2.9860000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.63400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.22500000000000001},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.276},"last":0.69399999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.3620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68500000000000005,"15min":0.77600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.22700000000000001},"max":{"1min":1.04,"5min":1.3320000000000001,"15min":11.891},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.79400000000000004},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0640000000000001,"5min":1.3859999999999999,"15min":4.8230000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.86799999999999999},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":1.2689999999999999,"15min":4.9349999999999996},"last":0.89000000000000001}]},{"osd":4,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.999,"15min":1},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":3.4529999999999998,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":0.98899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":1.482,"5min":1.585,"15min":1.6080000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.98899999999999999,"15min":1.2789999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4650000000000001,"5min":1.714,"15min":57.396999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.02,"15min":1.1299999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42099999999999999},"max":{"1min":1.1879999999999999,"5min":2.54,"15min":25.677},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.018,"15min":1.137},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.7809999999999999,"15min":21.785},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"max":{"1min":1.5229999999999999,"5min":1.804,"15min":2.7949999999999999},"last":1.0609999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.042,"15min":1.1539999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.25,"5min":1.5509999999999999,"15min":12.884},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.1479999999999999},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.397,"5min":1.665,"15min":5.3209999999999997},"last":1.29}]}]},{"osd":2,"up_from":13,"seq":55834575777,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":992908,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":992510,"kb_avail":93378932,"statfs":{"total":96636764160,"available":95620026368,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1016330507},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":205,"apply_latency_ms":205,"commit_latency_ns":205000000,"apply_latency_ns":205000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64300000000000002,"15min":0.83399999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.018,"5min":1.696,"15min":39.767000000000003},"last":3.4470000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.76000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.223},"max":{"1min":2.516,"5min":2.516,"15min":11.352},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.755},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":1.2689999999999999,"5min":1.3240000000000001,"15min":2.3140000000000001},"last":3.4969999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.755,"15min":0.86099999999999999},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":13.101000000000001},"last":0.373}]},{"osd":3,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.79600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.26000000000000001},"max":{"1min":1.0149999999999999,"5min":1.7370000000000001,"15min":7.1710000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.90900000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":1.069,"5min":1.887,"15min":6.891},"last":3.4729999999999999}]},{"osd":4,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.681,"5min":3.681,"15min":5.0899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":0.96499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.313},"max":{"1min":1.3149999999999999,"5min":1.5249999999999999,"15min":4.5869999999999997},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.054,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.5620000000000001,"15min":8.4190000000000005},"last":9.2469999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.091,"15min":1.1319999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.7549999999999999,"5min":3.7549999999999999,"15min":4.577},"last":9.1809999999999992}]},{"osd":6,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98199999999999998,"15min":1.0640000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.39400000000000002},"max":{"1min":1.534,"5min":1.792,"15min":5.859},"last":0.628},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0700000000000001,"15min":1.179},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45700000000000002},"max":{"1min":1.667,"5min":1.667,"15min":13.824},"last":3.4129999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.147,"15min":1.1639999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.002,"15min":1.099},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.36699999999999999},"max":{"1min":1.619,"5min":1.619,"15min":4.6580000000000004},"last":0.73699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575778,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1502288,"kb_used_data":8584,"kb_used_omap":1,"kb_used_meta":1493694,"kb_avail":92869552,"statfs":{"total":96636764160,"available":95098421248,"internally_reserved":0,"allocated":8790016,"data_stored":8548711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1529542923},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":159,"apply_latency_ms":159,"commit_latency_ns":159000000,"apply_latency_ns":159000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63800000000000001,"15min":0.749},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":25.135999999999999},"last":5.9740000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.64000000000000001,"15min":0.754},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.601,"5min":2.601,"15min":25.262},"last":6.0999999999999996}]},{"osd":2,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63600000000000001,"15min":0.67800000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.3,"5min":1.478,"15min":3.6139999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.679,"5min":1.679,"15min":4.8259999999999996},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.931,"5min":1.931,"15min":5.4850000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.28399999999999997},"max":{"1min":1.4450000000000001,"5min":1.7769999999999999,"15min":7.9800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.073},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":4.8710000000000004},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":4.3810000000000002,"5min":1.7130000000000001,"15min":1.337},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.41399999999999998},"max":{"1min":74.188000000000002,"5min":74.188000000000002,"15min":74.188000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.71,"15min":1.3260000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":74.143000000000001,"5min":74.143000000000001,"15min":74.143000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.1759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.373},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":16.021999999999998},"last":0.44},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39000000000000001},"max":{"1min":1.522,"5min":1.804,"15min":7.6950000000000003},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.141,"15min":1.1779999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.8600000000000003},"last":2.3809999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.1200000000000001,"15min":1.234},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44700000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":16.082000000000001},"last":0.51100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575780,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889164,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":888190,"kb_avail":93482676,"statfs":{"total":96636764160,"available":95726260224,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":909506827},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":203,"apply_latency_ms":203,"commit_latency_ns":203000000,"apply_latency_ns":203000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.65200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2869999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.032,"5min":1.26,"15min":1.3899999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.72099999999999997},"min":{"1min":0.35099999999999998,"5min":0.27100000000000002,"15min":0.222},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.585},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98099999999999998,"5min":1.083,"15min":6.399},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":18.024999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.86799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.173,"5min":1.194,"15min":1.5289999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94899999999999995,"15min":1.0149999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.454,"5min":1.5489999999999999,"15min":6.3499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2869999999999999,"5min":1.3700000000000001,"15min":1.593},"last":0.77700000000000002}]},{"osd":5,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89900000000000002,"15min":0.94799999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.587},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.9930000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.143},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.371},"max":{"1min":1.651,"5min":1.651,"15min":2.101},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.1220000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.45,"15min":6.3109999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0249999999999999,"15min":1.113},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.415,"5min":1.6140000000000001,"15min":6.3760000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":1.0529999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3700000000000001,"5min":1.4990000000000001,"15min":1.6699999999999999},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T14:01:18.567 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T14:01:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 Processor -- start 2024-01-24T14:01:18.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 -- start start 2024-01-24T14:01:18.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5b4070910 0x7fb5b4152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b4071180 con 0x7fb5b4070010 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b4141e10 con 0x7fb5b4071610 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b88b7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40ba1d0 con 0x7fb5b4070910 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b2d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5b4070910 0x7fb5b4152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b259c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb5b4070010 0x7fb5b4147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36790/0 (socket says 172.21.15.27:36790) 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b259c640 1 -- 172.21.15.27:0/540706117 learned_addr learned my addr 172.21.15.27:0/540706117 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/540706117 >> v1:172.21.15.124:6789/0 conn(0x7fb5b4071610 legacy=0x7fb5b4141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/540706117 >> v1:172.21.15.27:6789/0 conn(0x7fb5b4070010 legacy=0x7fb5b4147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b159a640 1 -- 172.21.15.27:0/540706117 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913421847 0 0) 0x7fb5b4071180 con 0x7fb5b4070010 2024-01-24T14:01:18.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/540706117 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40b9c10 con 0x7fb5b4070910 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b2d9d640 1 --2- 172.21.15.27:0/540706117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4070910 0x7fb5b4152f80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00bfd0 tx=0x7fb5ac01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a936d359f81971e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b159a640 1 -- 172.21.15.27:0/540706117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00b2d0 con 0x7fb5b4070910 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b159a640 1 -- 172.21.15.27:0/540706117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0a76c0 con 0x7fb5b4070910 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.681+0000 7fb5b159a640 1 -- 172.21.15.27:0/540706117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0a7a50 con 0x7fb5b4070910 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/540706117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4070910 msgr2=0x7fb5b4152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/540706117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4070910 0x7fb5b4152f80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00bfd0 tx=0x7fb5ac01eaf0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/540706117 shutdown_connections 2024-01-24T14:01:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/540706117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4070910 0x7fb5b4152f80 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/540706117 >> 172.21.15.27:0/540706117 conn(0x7fb5b406ae30 msgr2=0x7fb5b406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/540706117 shutdown_connections 2024-01-24T14:01:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/540706117 wait complete. 2024-01-24T14:01:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 Processor -- start 2024-01-24T14:01:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- start start 2024-01-24T14:01:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5b4070010 0x7fb5b4130130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5b4070910 0x7fb5b4146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4130670 con 0x7fb5b4071610 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4145a40 con 0x7fb5b4070010 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4145480 con 0x7fb5b4070910 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39366/0 (socket says 172.21.15.27:39366) 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/4279945676 learned_addr learned my addr 172.21.15.27:0/4279945676 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:18.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5b4070910 msgr2=0x7fb5b4146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5b4070910 0x7fb5b4146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5b4070010 msgr2=0x7fb5b4130130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5b4070010 0x7fb5b4130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 -- 172.21.15.27:0/4279945676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac00bc80 con 0x7fb5b4071610 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b2d9d640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac025100 tx=0x7fb5ac01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac009540 con 0x7fb5b4071610 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0096a0 con 0x7fb5b4071610 2024-01-24T14:01:18.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b40bbe50 con 0x7fb5b4071610 2024-01-24T14:01:18.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac009a10 con 0x7fb5b4071610 2024-01-24T14:01:18.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b4140ff0 con 0x7fb5b4071610 2024-01-24T14:01:18.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.685+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b404e000 con 0x7fb5b4071610 2024-01-24T14:01:18.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.689+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5ac009b70 con 0x7fb5b4071610 2024-01-24T14:01:18.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.689+0000 7fb5a2ffd640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:18.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.689+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5ac11fc70 con 0x7fb5b4071610 2024-01-24T14:01:18.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.689+0000 7fb5b259c640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:18.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.689+0000 7fb5b259c640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 0x7fb594067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40011f0 tx=0x7fb5a4007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:18.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.693+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fb5ac0ed9c0 con 0x7fb5b4071610 2024-01-24T14:01:18.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.841+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b4145bf0 con 0x7fb5b4071610 2024-01-24T14:01:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5a2ffd640 1 -- 172.21.15.27:0/4279945676 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12516 (secure 0 0 0) 0x7fb5b4145bf0 con 0x7fb5b4071610 2024-01-24T14:01:18.846 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:18.846 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":34,"fsid":"c3b5c35b-344c-4b0c-8c00-a7c5d9dc0d98","created":"2024-01-24T12:43:46.996519+0000","modified":"2024-01-24T14:01:13.588843+0000","last_up_change":"2024-01-24T12:43:58.826619+0000","last_in_change":"2024-01-24T12:43:49.669258+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T12:43:59.705471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a89ae3c6-2dfb-4b27-8a11-bdc63d4c5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":27569},{"type":"v1","addr":"172.21.15.27:6809","nonce":27569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":27569},{"type":"v1","addr":"172.21.15.27:6813","nonce":27569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6819","nonce":27569},{"type":"v1","addr":"172.21.15.27:6821","nonce":27569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6815","nonce":27569},{"type":"v1","addr":"172.21.15.27:6817","nonce":27569}]},"public_addr":"172.21.15.27:6809/27569","cluster_addr":"172.21.15.27:6813/27569","heartbeat_back_addr":"172.21.15.27:6821/27569","heartbeat_front_addr":"172.21.15.27:6817/27569","state":["exists","up"]},{"osd":1,"uuid":"83339161-25cf-4ba5-9af9-a6a32cb24473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":27567},{"type":"v1","addr":"172.21.15.27:6811","nonce":27567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":27567},{"type":"v1","addr":"172.21.15.27:6816","nonce":27567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":27567},{"type":"v1","addr":"172.21.15.27:6823","nonce":27567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":27567},{"type":"v1","addr":"172.21.15.27:6820","nonce":27567}]},"public_addr":"172.21.15.27:6811/27567","cluster_addr":"172.21.15.27:6816/27567","heartbeat_back_addr":"172.21.15.27:6823/27567","heartbeat_front_addr":"172.21.15.27:6820/27567","state":["exists","up"]},{"osd":2,"uuid":"276b88b3-3381-4775-86fe-a5178646e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":27566},{"type":"v1","addr":"172.21.15.27:6825","nonce":27566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":27566},{"type":"v1","addr":"172.21.15.27:6827","nonce":27566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":27566},{"type":"v1","addr":"172.21.15.27:6831","nonce":27566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":27566},{"type":"v1","addr":"172.21.15.27:6829","nonce":27566}]},"public_addr":"172.21.15.27:6825/27566","cluster_addr":"172.21.15.27:6827/27566","heartbeat_back_addr":"172.21.15.27:6831/27566","heartbeat_front_addr":"172.21.15.27:6829/27566","state":["exists","up"]},{"osd":3,"uuid":"70572fb0-83b9-41aa-9a4c-ba6190b304da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":27568},{"type":"v1","addr":"172.21.15.27:6801","nonce":27568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":27568},{"type":"v1","addr":"172.21.15.27:6803","nonce":27568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":27568},{"type":"v1","addr":"172.21.15.27:6807","nonce":27568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":27568},{"type":"v1","addr":"172.21.15.27:6805","nonce":27568}]},"public_addr":"172.21.15.27:6801/27568","cluster_addr":"172.21.15.27:6803/27568","heartbeat_back_addr":"172.21.15.27:6807/27568","heartbeat_front_addr":"172.21.15.27:6805/27568","state":["exists","up"]},{"osd":4,"uuid":"c438646a-e5ea-461f-bcd1-7c46aac26cbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6804","nonce":27688},{"type":"v1","addr":"172.21.15.124:6805","nonce":27688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6807","nonce":27688},{"type":"v1","addr":"172.21.15.124:6809","nonce":27688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6814","nonce":27688},{"type":"v1","addr":"172.21.15.124:6815","nonce":27688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6811","nonce":27688},{"type":"v1","addr":"172.21.15.124:6813","nonce":27688}]},"public_addr":"172.21.15.124:6805/27688","cluster_addr":"172.21.15.124:6809/27688","heartbeat_back_addr":"172.21.15.124:6815/27688","heartbeat_front_addr":"172.21.15.124:6813/27688","state":["exists","up"]},{"osd":5,"uuid":"ccec405d-3dfc-4e49-906d-49ee028fa898","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6816","nonce":27689},{"type":"v1","addr":"172.21.15.124:6817","nonce":27689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6818","nonce":27689},{"type":"v1","addr":"172.21.15.124:6819","nonce":27689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6822","nonce":27689},{"type":"v1","addr":"172.21.15.124:6823","nonce":27689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6820","nonce":27689},{"type":"v1","addr":"172.21.15.124:6821","nonce":27689}]},"public_addr":"172.21.15.124:6817/27689","cluster_addr":"172.21.15.124:6819/27689","heartbeat_back_addr":"172.21.15.124:6823/27689","heartbeat_front_addr":"172.21.15.124:6821/27689","state":["exists","up"]},{"osd":6,"uuid":"14b393b9-490b-4ea6-958e-47695fe336a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6824","nonce":27690},{"type":"v1","addr":"172.21.15.124:6825","nonce":27690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6826","nonce":27690},{"type":"v1","addr":"172.21.15.124:6827","nonce":27690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6830","nonce":27690},{"type":"v1","addr":"172.21.15.124:6831","nonce":27690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6828","nonce":27690},{"type":"v1","addr":"172.21.15.124:6829","nonce":27690}]},"public_addr":"172.21.15.124:6825/27690","cluster_addr":"172.21.15.124:6827/27690","heartbeat_back_addr":"172.21.15.124:6831/27690","heartbeat_front_addr":"172.21.15.124:6829/27690","state":["exists","up"]},{"osd":7,"uuid":"44ce85bf-7710-4bf8-9ea1-46e665a7036c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6800","nonce":27691},{"type":"v1","addr":"172.21.15.124:6801","nonce":27691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6802","nonce":27691},{"type":"v1","addr":"172.21.15.124:6803","nonce":27691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6810","nonce":27691},{"type":"v1","addr":"172.21.15.124:6812","nonce":27691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6806","nonce":27691},{"type":"v1","addr":"172.21.15.124:6808","nonce":27691}]},"public_addr":"172.21.15.124:6801/27691","cluster_addr":"172.21.15.124:6803/27691","heartbeat_back_addr":"172.21.15.124:6812/27691","heartbeat_front_addr":"172.21.15.124:6808/27691","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.257491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.324547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.325462+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.248647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.120882+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.258032+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.231060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T12:43:55.343320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6835/555930639":"2024-01-25T14:01:10.536226+0000","172.21.15.27:6833/555930639":"2024-01-25T14:01:10.536226+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 msgr2=0x7fb594067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 0x7fb594067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40011f0 tx=0x7fb5a4007930 comp rx=0 tx=0).stop 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 msgr2=0x7fb5b413f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac025100 tx=0x7fb5ac01b890 comp rx=0 tx=0).stop 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 shutdown_connections 2024-01-24T14:01:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fb594065a60 0x7fb594067f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5b4071610 0x7fb5b413f8c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fb5b4070910 0x7fb5b4146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 --2- 172.21.15.27:0/4279945676 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fb5b4070010 0x7fb5b4130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 >> 172.21.15.27:0/4279945676 conn(0x7fb5b406ae30 msgr2=0x7fb5b4072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 shutdown_connections 2024-01-24T14:01:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:18.845+0000 7fb5b88b7640 1 -- 172.21.15.27:0/4279945676 wait complete. 2024-01-24T14:01:19.864 INFO:tasks.ceph:Scrubbing osd.0 2024-01-24T14:01:19.865 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:19.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 Processor -- start 2024-01-24T14:01:20.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 -- start start 2024-01-24T14:01:20.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fa4940b5060 0x7fa494148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa494149460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49406e220 con 0x7fa4940b44a0 2024-01-24T14:01:20.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940ba850 con 0x7fa4940b5060 2024-01-24T14:01:20.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49b4e1640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49406df40 con 0x7fa4940a0c90 2024-01-24T14:01:20.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49927d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa4940b44a0 0x7fa4941427e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36796/0 (socket says 172.21.15.27:36796) 2024-01-24T14:01:20.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49927d640 1 -- 172.21.15.27:0/4060877578 learned_addr learned my addr 172.21.15.27:0/4060877578 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:20.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975861057 0 0) 0x7fa49406e220 con 0x7fa4940b44a0 2024-01-24T14:01:20.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa480003530 con 0x7fa4940b44a0 2024-01-24T14:01:20.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 --2- 172.21.15.27:0/4060877578 >> v2:172.21.15.124:3300/0 conn(0x7fa4940b5060 0x7fa494148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa499a7e640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa494149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755808152 0 0) 0x7fa480003530 con 0x7fa4940b44a0 2024-01-24T14:01:20.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 msgr2=0x7fa494149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa494149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 >> v2:172.21.15.124:3300/0 conn(0x7fa4940b5060 msgr2=0x7fa494148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 --2- 172.21.15.27:0/4060877578 >> v2:172.21.15.124:3300/0 conn(0x7fa4940b5060 0x7fa494148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494148a00 con 0x7fa4940b44a0 2024-01-24T14:01:20.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fa490001680 con 0x7fa4940b44a0 2024-01-24T14:01:20.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 >> v1:172.21.15.27:6789/0 conn(0x7fa4940b44a0 legacy=0x7fa4941427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa480003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa480003f00 0x7fa4800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa480004d10 0x7fa480005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940ba850 con 0x7fa480003f00 2024-01-24T14:01:20.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49406df40 con 0x7fa480004d10 2024-01-24T14:01:20.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48000b990 con 0x7fa4940a0c90 2024-01-24T14:01:20.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa480003f00 0x7fa4800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49927d640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa480003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 -- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 msgr2=0x7fa480003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa480003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 -- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa480004d10 msgr2=0x7fa480005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa480004d10 0x7fa480005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa498a7c640 1 -- 172.21.15.27:0/4060877578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480003530 con 0x7fa480003f00 2024-01-24T14:01:20.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.985+0000 7fa49927d640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa4940a0c90 0x7fa480003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa498a7c640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa480003f00 0x7fa4800047d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa494070ce0 tx=0x7fa48401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8efa3fe166eaac server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840a5620 con 0x7fa480003f00 2024-01-24T14:01:20.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa490001d80 con 0x7fa480003f00 2024-01-24T14:01:20.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa48bfff640 1 -- 172.21.15.27:0/4060877578 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840a59c0 con 0x7fa480003f00 2024-01-24T14:01:20.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- 172.21.15.27:0/4060877578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa480003f00 msgr2=0x7fa4800047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 --2- 172.21.15.27:0/4060877578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa480003f00 0x7fa4800047d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa494070ce0 tx=0x7fa48401c9d0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa499a7e640 1 -- 172.21.15.27:0/4060877578 reap_dead start 2024-01-24T14:01:20.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- 172.21.15.27:0/4060877578 shutdown_connections 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- 172.21.15.27:0/4060877578 >> 172.21.15.27:0/4060877578 conn(0x7fa4940babc0 msgr2=0x7fa4940bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- 172.21.15.27:0/4060877578 shutdown_connections 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- 172.21.15.27:0/4060877578 wait complete. 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 Processor -- start 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- start start 2024-01-24T14:01:20.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa480003f00 0x7fa4940bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4940b5920 0x7fa49413b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 0x7fa4941e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940bd710 con 0x7fa49413ba00 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940b64f0 con 0x7fa4940b5920 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49b4e1640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4941dd7d0 con 0x7fa480003f00 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa499a7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 0x7fa4941e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa499a7e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 0x7fa4941e0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39394/0 (socket says 172.21.15.27:39394) 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa499a7e640 1 -- 172.21.15.27:0/3119134553 learned_addr learned my addr 172.21.15.27:0/3119134553 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa49927d640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa480003f00 0x7fa4940bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.989+0000 7fa498a7c640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4940b5920 0x7fa49413b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 -- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa480003f00 msgr2=0x7fa4940bd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fa480003f00 0x7fa4940bd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 -- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4940b5920 msgr2=0x7fa49413b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4940b5920 0x7fa49413b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4941dda70 con 0x7fa49413ba00 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa498a7c640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fa4940b5920 0x7fa49413b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa499a7e640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 0x7fa4941e0d40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa4940a3670 tx=0x7fa48c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c010040 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c00ba80 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4941ddd50 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00be10 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4941de310 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa494142ef0 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa48c028430 con 0x7fa49413ba00 2024-01-24T14:01:20.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa478065a90 0x7fa478067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa48c083a90 con 0x7fa49413ba00 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fa47806b8f0 0x7fa47806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa47806e3c0 con 0x7fa47806b8f0 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa48c083ee0 con 0x7fa49413ba00 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa49927d640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa478065a90 0x7fa478067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa498a7c640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fa47806b8f0 0x7fa47806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa498a7c640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fa47806b8f0 0x7fa47806dd10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa49927d640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa478065a90 0x7fa478067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa490004880 tx=0x7fa490005150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:19.993+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== osd.0 v2:172.21.15.27:6808/27569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa47806e3c0 con 0x7fa47806b8f0 2024-01-24T14:01:20.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.005+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 --> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa4940b4880 con 0x7fa47806b8f0 2024-01-24T14:01:20.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.005+0000 7fa489ffb640 1 -- 172.21.15.27:0/3119134553 <== osd.0 v2:172.21.15.27:6808/27569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa4840a5720 con 0x7fa47806b8f0 2024-01-24T14:01:20.016 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:20.016 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:20.016 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:20.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fa47806b8f0 msgr2=0x7fa47806dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:6808/27569,v1:172.21.15.27:6809/27569] conn(0x7fa47806b8f0 0x7fa47806dd10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa478065a90 msgr2=0x7fa478067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fa478065a90 0x7fa478067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa490004880 tx=0x7fa490005150 comp rx=0 tx=0).stop 2024-01-24T14:01:20.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 msgr2=0x7fa4941e0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 --2- 172.21.15.27:0/3119134553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa49413ba00 0x7fa4941e0d40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa4940a3670 tx=0x7fa48c00b480 comp rx=0 tx=0).stop 2024-01-24T14:01:20.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa499a7e640 1 -- 172.21.15.27:0/3119134553 reap_dead start 2024-01-24T14:01:20.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 shutdown_connections 2024-01-24T14:01:20.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 >> 172.21.15.27:0/3119134553 conn(0x7fa4940babc0 msgr2=0x7fa4940b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 shutdown_connections 2024-01-24T14:01:20.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.009+0000 7fa49b4e1640 1 -- 172.21.15.27:0/3119134553 wait complete. 2024-01-24T14:01:20.026 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-24T14:01:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.129+0000 7f24d3539640 1 Processor -- start 2024-01-24T14:01:20.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.129+0000 7f24d3539640 1 -- start start 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f24cc14b540 0x7f24cc0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f24cc14dfd0 0x7f24cc14e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc06ae40 con 0x7f24cc14b540 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0bc320 con 0x7f24cc14dfd0 2024-01-24T14:01:20.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d3539640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0bb650 con 0x7f24cc06a4c0 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f24cc14b540 0x7f24cc0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f24cc14b540 0x7f24cc0bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39410/0 (socket says 172.21.15.27:39410) 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 -- 172.21.15.27:0/1459531749 learned_addr learned my addr 172.21.15.27:0/1459531749 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d0ad4640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d1ad6640 1 --2- 172.21.15.27:0/1459531749 >> v2:172.21.15.124:3300/0 conn(0x7f24cc14dfd0 0x7f24cc14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 -- 172.21.15.27:0/1459531749 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 msgr2=0x7f24cc06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 -- 172.21.15.27:0/1459531749 >> v2:172.21.15.124:3300/0 conn(0x7f24cc14dfd0 msgr2=0x7f24cc14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 --2- 172.21.15.27:0/1459531749 >> v2:172.21.15.124:3300/0 conn(0x7f24cc14dfd0 0x7f24cc14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 -- 172.21.15.27:0/1459531749 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc0bc590 con 0x7f24cc14b540 2024-01-24T14:01:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24d12d5640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc0bac60 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f24cc08aa10 tx=0x7f24c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e79b9757918138f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24c3fff640 1 -- 172.21.15.27:0/1459531749 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a89b0 con 0x7f24cc14b540 2024-01-24T14:01:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24c3fff640 1 -- 172.21.15.27:0/1459531749 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80a8b10 con 0x7f24cc14b540 2024-01-24T14:01:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.133+0000 7f24c3fff640 1 -- 172.21.15.27:0/1459531749 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a8ea0 con 0x7f24cc14b540 2024-01-24T14:01:20.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/1459531749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 msgr2=0x7f24cc0bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc0bac60 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f24cc08aa10 tx=0x7f24c801ecf0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/1459531749 shutdown_connections 2024-01-24T14:01:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- 172.21.15.27:0/1459531749 >> v2:172.21.15.124:3300/0 conn(0x7f24cc14dfd0 0x7f24cc14e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- 172.21.15.27:0/1459531749 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc0bac60 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/1459531749 >> 172.21.15.27:0/1459531749 conn(0x7f24cc0c02e0 msgr2=0x7f24cc0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/1459531749 shutdown_connections 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/1459531749 wait complete. 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 Processor -- start 2024-01-24T14:01:20.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- start start 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 0x7f24cc0b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc14db60 con 0x7f24cc14b540 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0b94c0 con 0x7f24cc14dfd0 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0b7710 con 0x7f24cc06a4c0 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39414/0 (socket says 172.21.15.27:39414) 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 -- 172.21.15.27:0/2411507182 learned_addr learned my addr 172.21.15.27:0/2411507182 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d12d5640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d1ad6640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 0x7f24cc0b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 -- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 msgr2=0x7f24cc0b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc0b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 -- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 msgr2=0x7f24cc0b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 0x7f24cc0b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 -- 172.21.15.27:0/2411507182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80094d0 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d12d5640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc0b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d1ad6640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 0x7f24cc0b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d0ad4640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c820 tx=0x7f24bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc007a30 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc007b90 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00ce10 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0b79f0 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc0b8040 con 0x7f24cc14b540 2024-01-24T14:01:20.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.137+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc04e000 con 0x7f24cc14b540 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.141+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24bc0113f0 con 0x7f24cc14b540 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.141+0000 7f24c1ffb640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 0x7f24b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.141+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f24bc082ef0 con 0x7f24cc14b540 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.141+0000 7f24d12d5640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 0x7f24b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.141+0000 7f24d12d5640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 0x7f24b0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b2000 tx=0x7f24c80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.145+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f24bc050bb0 con 0x7f24cc14b540 2024-01-24T14:01:20.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.293+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f24cc0b7880 con 0x7f24b0065a60 2024-01-24T14:01:20.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.297+0000 7f24c1ffb640 1 -- 172.21.15.27:0/2411507182 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f24cc0b7880 con 0x7f24b0065a60 2024-01-24T14:01:20.298 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 0 to deep-scrub 2024-01-24T14:01:20.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.297+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 msgr2=0x7f24b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.297+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 0x7f24b0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b2000 tx=0x7f24c80aa070 comp rx=0 tx=0).stop 2024-01-24T14:01:20.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.297+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 msgr2=0x7f24cc14d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.297+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c820 tx=0x7f24bc00cce0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 shutdown_connections 2024-01-24T14:01:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f24b0065a60 0x7f24b0067f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f24cc14dfd0 0x7f24cc0b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24cc14b540 0x7f24cc14d620 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 --2- 172.21.15.27:0/2411507182 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f24cc06a4c0 0x7f24cc0b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 >> 172.21.15.27:0/2411507182 conn(0x7f24cc0c02e0 msgr2=0x7f24cc0bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 shutdown_connections 2024-01-24T14:01:20.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.301+0000 7f24d3539640 1 -- 172.21.15.27:0/2411507182 wait complete. 2024-01-24T14:01:20.318 INFO:tasks.ceph:Scrubbing osd.1 2024-01-24T14:01:20.319 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 Processor -- start 2024-01-24T14:01:20.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 -- start start 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75480b9270 0x7f7548142720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b3e60 0x7f7548153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480b7df0 con 0x7f75480b6880 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75480b8e50 con 0x7f75480b9270 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754ff67640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75480b8070 con 0x7f75480b3e60 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75480b9270 0x7f7548142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f75480b9270 0x7f7548142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39422/0 (socket says 172.21.15.27:39422) 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 -- 172.21.15.27:0/1494635816 learned_addr learned my addr 172.21.15.27:0/1494635816 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754e504640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b3e60 0x7f7548153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 -- 172.21.15.27:0/1494635816 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b3e60 msgr2=0x7f7548153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b3e60 0x7f7548153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 -- 172.21.15.27:0/1494635816 >> v1:172.21.15.124:6789/0 conn(0x7f75480b6880 legacy=0x7f754814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.433+0000 7f754d502640 1 -- 172.21.15.27:0/1494635816 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480b8a70 con 0x7f75480b9270 2024-01-24T14:01:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754d502640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f7548142720 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4e770a0b98e48d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754cd01640 1 -- 172.21.15.27:0/1494635816 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380ab600 con 0x7f75480b9270 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754cd01640 1 -- 172.21.15.27:0/1494635816 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75380a7050 con 0x7f75480b9270 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754cd01640 1 -- 172.21.15.27:0/1494635816 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380ab980 con 0x7f75480b9270 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/1494635816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 msgr2=0x7f7548142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f7548142720 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753801c470 comp rx=0 tx=0).stop 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/1494635816 shutdown_connections 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b3e60 0x7f7548153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- 172.21.15.27:0/1494635816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f7548142720 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/1494635816 >> 172.21.15.27:0/1494635816 conn(0x7f75480bcf70 msgr2=0x7f75480bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/1494635816 shutdown_connections 2024-01-24T14:01:20.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/1494635816 wait complete. 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 Processor -- start 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- start start 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75480b3e60 0x7f75481e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b6880 0x7f754813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f754813f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7548143a60 con 0x7f75480b9270 2024-01-24T14:01:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75481e46c0 con 0x7f75480b3e60 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7548140e10 con 0x7f75480b6880 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f754813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f754813f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39428/0 (socket says 172.21.15.27:39428) 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 -- 172.21.15.27:0/3248001375 learned_addr learned my addr 172.21.15.27:0/3248001375 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754d502640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b6880 0x7f754813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754dd03640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75480b3e60 0x7f75481e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 -- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b6880 msgr2=0x7f754813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f75480b6880 0x7f754813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 -- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75480b3e60 msgr2=0x7f75481e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f75480b3e60 0x7f75481e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380094d0 con 0x7f75480b9270 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754e504640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f754813f860 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f754000cd60 tx=0x7f754000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540003ba0 con 0x7f75480b9270 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540003d20 con 0x7f75480b9270 2024-01-24T14:01:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7548138b70 con 0x7f75480b9270 2024-01-24T14:01:20.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540004260 con 0x7f75480b9270 2024-01-24T14:01:20.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7548143780 con 0x7f75480b9270 2024-01-24T14:01:20.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.437+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7548155d80 con 0x7f75480b9270 2024-01-24T14:01:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f75400043c0 con 0x7f75480b9270 2024-01-24T14:01:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f752c065a60 0x7f752c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7540012070 con 0x7f75480b9270 2024-01-24T14:01:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f752c06b8c0 0x7f752c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f752c06e390 con 0x7f752c06b8c0 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7540085cc0 con 0x7f75480b9270 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f754d502640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f752c06b8c0 0x7f752c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f754dd03640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f752c065a60 0x7f752c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f754d502640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f752c06b8c0 0x7f752c06dce0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f754dd03640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f752c065a60 0x7f752c067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7544004e30 tx=0x7f7544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.441+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== osd.1 v2:172.21.15.27:6810/27567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f752c06e390 con 0x7f752c06b8c0 2024-01-24T14:01:20.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 --> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f754804e000 con 0x7f752c06b8c0 2024-01-24T14:01:20.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f753e7fc640 1 -- 172.21.15.27:0/3248001375 <== osd.1 v2:172.21.15.27:6810/27567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f754804e000 con 0x7f752c06b8c0 2024-01-24T14:01:20.457 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:20.458 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:20.458 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:20.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f752c06b8c0 msgr2=0x7f752c06dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:6810/27567,v1:172.21.15.27:6811/27567] conn(0x7f752c06b8c0 0x7f752c06dce0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f752c065a60 msgr2=0x7f752c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f752c065a60 0x7f752c067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7544004e30 tx=0x7f7544009040 comp rx=0 tx=0).stop 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 msgr2=0x7f754813f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 --2- 172.21.15.27:0/3248001375 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f75480b9270 0x7f754813f860 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f754000cd60 tx=0x7f754000a660 comp rx=0 tx=0).stop 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754e504640 1 -- 172.21.15.27:0/3248001375 reap_dead start 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 shutdown_connections 2024-01-24T14:01:20.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 >> 172.21.15.27:0/3248001375 conn(0x7f75480bcf70 msgr2=0x7f754806adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 shutdown_connections 2024-01-24T14:01:20.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.453+0000 7f754ff67640 1 -- 172.21.15.27:0/3248001375 wait complete. 2024-01-24T14:01:20.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-24T14:01:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 Processor -- start 2024-01-24T14:01:20.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 -- start start 2024-01-24T14:01:20.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fe2e8141b70 0x7fe2e8070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e8071e60 con 0x7fe2e806a840 2024-01-24T14:01:20.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e8071850 con 0x7fe2e8148050 2024-01-24T14:01:20.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2f027d640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e80723a0 con 0x7fe2e8141b70 2024-01-24T14:01:20.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed818640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe2e806a840 0x7fe2e8147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:36812/0 (socket says 172.21.15.27:36812) 2024-01-24T14:01:20.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed818640 1 -- 172.21.15.27:0/1217487235 learned_addr learned my addr 172.21.15.27:0/1217487235 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:20.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 --2- 172.21.15.27:0/1217487235 >> v2:172.21.15.124:3300/0 conn(0x7fe2e8141b70 0x7fe2e8070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777072955 0 0) 0x7fe2e8071e60 con 0x7fe2e806a840 2024-01-24T14:01:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003530 con 0x7fe2e806a840 2024-01-24T14:01:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554133598 0 0) 0x7fe2d4003530 con 0x7fe2e806a840 2024-01-24T14:01:20.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 >> v2:172.21.15.124:3300/0 conn(0x7fe2e8141b70 msgr2=0x7fe2e8070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 --2- 172.21.15.27:0/1217487235 >> v2:172.21.15.124:3300/0 conn(0x7fe2e8141b70 0x7fe2e8070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 >> v1:172.21.15.124:6789/0 conn(0x7fe2e8148050 legacy=0x7fe2e81520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8071af0 con 0x7fe2e806a840 2024-01-24T14:01:20.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fe2d8001680 con 0x7fe2e806a840 2024-01-24T14:01:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 >> v1:172.21.15.27:6789/0 conn(0x7fe2e806a840 legacy=0x7fe2e8147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 0x7fe2d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d40047d0 0x7fe2d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2d4005190 0x7fe2d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d400c010 con 0x7fe2d4003980 2024-01-24T14:01:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d400c180 con 0x7fe2d4005190 2024-01-24T14:01:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d400c340 con 0x7fe2d40047d0 2024-01-24T14:01:20.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 0x7fe2d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 -- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d40047d0 msgr2=0x7fe2d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d40047d0 0x7fe2d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 -- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2d4005190 msgr2=0x7fe2d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee81a640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2d4005190 0x7fe2d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2d4005190 0x7fe2d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee019640 1 -- 172.21.15.27:0/1217487235 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4003530 con 0x7fe2d4003980 2024-01-24T14:01:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee81a640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2d4005190 0x7fe2d400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.581+0000 7fe2ee81a640 1 -- 172.21.15.27:0/1217487235 reap_dead start 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee019640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 0x7fe2d4003da0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009ae0 tx=0x7fe2e401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717021282b62ca2a server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40a5640 con 0x7fe2d4003980 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e40a57a0 con 0x7fe2d4003980 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ed017640 1 -- 172.21.15.27:0/1217487235 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40a5b50 con 0x7fe2d4003980 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 msgr2=0x7fe2d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 0x7fe2d4003da0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009ae0 tx=0x7fe2e401ca50 comp rx=0 tx=0).stop 2024-01-24T14:01:20.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- 172.21.15.27:0/1217487235 shutdown_connections 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 --2- 172.21.15.27:0/1217487235 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d4003980 0x7fe2d4003da0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- 172.21.15.27:0/1217487235 >> 172.21.15.27:0/1217487235 conn(0x7fe2e8069d20 msgr2=0x7fe2e806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- 172.21.15.27:0/1217487235 shutdown_connections 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- 172.21.15.27:0/1217487235 wait complete. 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 Processor -- start 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- start start 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d4003980 0x7fe2e8144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2e8142e10 0x7fe2e8143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8144a50 con 0x7fe2e80b2600 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8143790 con 0x7fe2e8142e10 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2f027d640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81dd8c0 con 0x7fe2d4003980 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39442/0 (socket says 172.21.15.27:39442) 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 -- 172.21.15.27:0/2387345282 learned_addr learned my addr 172.21.15.27:0/2387345282 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ed818640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2e8142e10 0x7fe2e8143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee019640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d4003980 0x7fe2e8144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 -- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d4003980 msgr2=0x7fe2e8144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d4003980 0x7fe2e8144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 -- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2e8142e10 msgr2=0x7fe2e8143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2e8142e10 0x7fe2e8143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.585+0000 7fe2ee81a640 1 -- 172.21.15.27:0/2387345282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80b6bc0 con 0x7fe2e80b2600 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2ee81a640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8066900 tx=0x7fe2e000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0003e50 con 0x7fe2e80b2600 2024-01-24T14:01:20.600 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0005070 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e81ddb60 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0005420 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e81de120 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e804e000 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2e0005580 con 0x7fe2e80b2600 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2e00827b0 con 0x7fe2e80b2600 2024-01-24T14:01:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2ee019640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.589+0000 7fe2ee019640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 0x7fe2cc067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40af000 tx=0x7fe2e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.593+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fe2e00503f0 con 0x7fe2e80b2600 2024-01-24T14:01:20.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.745+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2e80b6a40 con 0x7fe2cc065a60 2024-01-24T14:01:20.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.745+0000 7fe2deffd640 1 -- 172.21.15.27:0/2387345282 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe2e4004020 con 0x7fe2cc065a60 2024-01-24T14:01:20.750 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 1 to deep-scrub 2024-01-24T14:01:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 msgr2=0x7fe2cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 0x7fe2cc067f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40af000 tx=0x7fe2e4008040 comp rx=0 tx=0).stop 2024-01-24T14:01:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 msgr2=0x7fe2e80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8066900 tx=0x7fe2e000d9d0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 shutdown_connections 2024-01-24T14:01:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fe2cc065a60 0x7fe2cc067f20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2e80b2600 0x7fe2e80b2a80 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fe2e8142e10 0x7fe2e8143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 --2- 172.21.15.27:0/2387345282 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fe2d4003980 0x7fe2e8144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 >> 172.21.15.27:0/2387345282 conn(0x7fe2e8069d20 msgr2=0x7fe2e806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 shutdown_connections 2024-01-24T14:01:20.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.749+0000 7fe2f027d640 1 -- 172.21.15.27:0/2387345282 wait complete. 2024-01-24T14:01:20.767 INFO:tasks.ceph:Scrubbing osd.2 2024-01-24T14:01:20.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:20.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 Processor -- start 2024-01-24T14:01:20.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 -- start start 2024-01-24T14:01:20.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f009406af90 0x7f00940b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940b5e60 con 0x7f00940b3c10 2024-01-24T14:01:20.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940b5680 con 0x7f0094148830 2024-01-24T14:01:20.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f009ac5a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940b4a30 con 0x7f009406af90 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00989f6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f009406af90 0x7f00940b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00991f7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f00940b3c10 0x7f00941530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59616/0 (socket says 172.21.15.27:59616) 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00991f7640 1 -- 172.21.15.27:0/2931088440 learned_addr learned my addr 172.21.15.27:0/2931088440 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00989f6640 1 -- 172.21.15.27:0/2931088440 >> v1:172.21.15.124:6789/0 conn(0x7f0094148830 legacy=0x7f0094142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00989f6640 1 -- 172.21.15.27:0/2931088440 >> v1:172.21.15.27:6789/0 conn(0x7f00940b3c10 legacy=0x7f00941530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.901+0000 7f00989f6640 1 -- 172.21.15.27:0/2931088440 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940b6830 con 0x7f009406af90 2024-01-24T14:01:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00989f6640 1 --2- 172.21.15.27:0/2931088440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f009406af90 0x7f00940b62f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f00840097c0 tx=0x7f008401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca4a1322616f353 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00937fe640 1 -- 172.21.15.27:0/2931088440 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840ab610 con 0x7f009406af90 2024-01-24T14:01:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00937fe640 1 -- 172.21.15.27:0/2931088440 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840ab770 con 0x7f009406af90 2024-01-24T14:01:20.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00937fe640 1 -- 172.21.15.27:0/2931088440 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840abb00 con 0x7f009406af90 2024-01-24T14:01:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/2931088440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f009406af90 msgr2=0x7f00940b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 --2- 172.21.15.27:0/2931088440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f009406af90 0x7f00940b62f0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f00840097c0 tx=0x7f008401c410 comp rx=0 tx=0).stop 2024-01-24T14:01:20.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/2931088440 shutdown_connections 2024-01-24T14:01:20.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 --2- 172.21.15.27:0/2931088440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f009406af90 0x7f00940b62f0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/2931088440 >> 172.21.15.27:0/2931088440 conn(0x7f00940b9170 msgr2=0x7f00940b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/2931088440 shutdown_connections 2024-01-24T14:01:20.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/2931088440 wait complete. 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 Processor -- start 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- start start 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f009406af90 0x7f0094152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00940b3c10 0x7f0094135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 0x7f00941e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940b46e0 con 0x7f0094148830 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094136360 con 0x7f009406af90 2024-01-24T14:01:20.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941e6600 con 0x7f00940b3c10 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 0x7f00941e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 0x7f00941e6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37270/0 (socket says 172.21.15.27:37270) 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 -- 172.21.15.27:0/1094922055 learned_addr learned my addr 172.21.15.27:0/1094922055 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00989f6640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f009406af90 0x7f0094152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f0093fff640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00940b3c10 0x7f0094135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 -- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00940b3c10 msgr2=0x7f0094135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f00940b3c10 0x7f0094135e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 -- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f009406af90 msgr2=0x7f0094152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f009406af90 0x7f0094152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084009420 con 0x7f0094148830 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00989f6640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f009406af90 0x7f0094152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00991f7640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 0x7f00941e6a90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f008c00cbf0 tx=0x7f008c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00ad40 con 0x7f0094148830 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c012400 con 0x7f0094148830 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094153470 con 0x7f0094148830 2024-01-24T14:01:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00aea0 con 0x7f0094148830 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.905+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094153a10 con 0x7f0094148830 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00940b5aa0 con 0x7f0094148830 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f008c007070 con 0x7f0094148830 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0080065a60 0x7f0080067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f008c082d90 con 0x7f0094148830 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f008006b8c0 0x7f008006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f008006e390 con 0x7f008006b8c0 2024-01-24T14:01:20.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008c085370 con 0x7f0094148830 2024-01-24T14:01:20.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f0093fff640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f008006b8c0 0x7f008006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00989f6640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0080065a60 0x7f0080067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:20.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f0093fff640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f008006b8c0 0x7f008006dce0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00989f6640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0080065a60 0x7f0080067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f00840af000 tx=0x7f0084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:20.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.909+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== osd.2 v2:172.21.15.27:6824/27566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f008006e390 con 0x7f008006b8c0 2024-01-24T14:01:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 --> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00940719c0 con 0x7f008006b8c0 2024-01-24T14:01:20.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f00917fa640 1 -- 172.21.15.27:0/1094922055 <== osd.2 v2:172.21.15.27:6824/27566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0088003e90 con 0x7f008006b8c0 2024-01-24T14:01:20.936 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:20.937 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:20.937 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f008006b8c0 msgr2=0x7f008006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:6824/27566,v1:172.21.15.27:6825/27566] conn(0x7f008006b8c0 0x7f008006dce0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0080065a60 msgr2=0x7f0080067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0080065a60 0x7f0080067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f00840af000 tx=0x7f0084008040 comp rx=0 tx=0).stop 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 msgr2=0x7f00941e6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 --2- 172.21.15.27:0/1094922055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0094148830 0x7f00941e6a90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f008c00cbf0 tx=0x7f008c00a430 comp rx=0 tx=0).stop 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f00991f7640 1 -- 172.21.15.27:0/1094922055 reap_dead start 2024-01-24T14:01:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 shutdown_connections 2024-01-24T14:01:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 >> 172.21.15.27:0/1094922055 conn(0x7f00940b9170 msgr2=0x7f00940b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 shutdown_connections 2024-01-24T14:01:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:20.933+0000 7f009ac5a640 1 -- 172.21.15.27:0/1094922055 wait complete. 2024-01-24T14:01:20.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-24T14:01:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 Processor -- start 2024-01-24T14:01:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 -- start start 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd38070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7fbd38141700 0x7fbd38151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd38071180 con 0x7fbd38071610 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd380ba1d0 con 0x7fbd38141700 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3ead3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b47f0 con 0x7fbd38070010 2024-01-24T14:01:21.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd37fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbd38071610 0x7fbd38147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59626/0 (socket says 172.21.15.27:59626) 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd37fff640 1 -- 172.21.15.27:0/1958044067 learned_addr learned my addr 172.21.15.27:0/1958044067 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1958044067 >> v2:172.21.15.124:3300/0 conn(0x7fbd38141700 0x7fbd38151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd38070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080022866 0 0) 0x7fbd38071180 con 0x7fbd38071610 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd28003530 con 0x7fbd38071610 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255727863 0 0) 0x7fbd28003530 con 0x7fbd38071610 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 msgr2=0x7fbd38070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd38070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 >> v2:172.21.15.124:3300/0 conn(0x7fbd38141700 msgr2=0x7fbd38151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 --2- 172.21.15.27:0/1958044067 >> v2:172.21.15.124:3300/0 conn(0x7fbd38141700 0x7fbd38151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380b9c10 con 0x7fbd38071610 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7fbd2c001680 con 0x7fbd38071610 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 >> v1:172.21.15.27:6789/0 conn(0x7fbd38071610 legacy=0x7fbd38147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd28003980 0x7fbd28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28004d10 0x7fbd28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380ba1d0 con 0x7fbd28003980 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2800b990 con 0x7fbd28004d10 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2800bad0 con 0x7fbd38070010 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd28003980 0x7fbd28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28004d10 0x7fbd28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd37fff640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 -- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 msgr2=0x7fbd280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38070010 0x7fbd280047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 -- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28004d10 msgr2=0x7fbd28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28004d10 0x7fbd28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3c86f640 1 -- 172.21.15.27:0/1958044067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28003530 con 0x7fbd28003980 2024-01-24T14:01:21.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.061+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28004d10 0x7fbd28005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:21.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd28003980 0x7fbd28003da0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009ae0 tx=0x7fbd2401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2939793c542829 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240a6430 con 0x7fbd28003980 2024-01-24T14:01:21.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd240a6590 con 0x7fbd28003980 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd377fe640 1 -- 172.21.15.27:0/1958044067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240a6940 con 0x7fbd28003980 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1958044067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd28003980 msgr2=0x7fbd28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1958044067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd28003980 0x7fbd28003da0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009ae0 tx=0x7fbd2401ca50 comp rx=0 tx=0).stop 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3d070640 1 -- 172.21.15.27:0/1958044067 reap_dead start 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1958044067 shutdown_connections 2024-01-24T14:01:21.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1958044067 >> 172.21.15.27:0/1958044067 conn(0x7fbd3806ae30 msgr2=0x7fbd3806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1958044067 shutdown_connections 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1958044067 wait complete. 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 Processor -- start 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.065+0000 7fbd3ead3640 1 -- start start 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28003980 0x7fbd380bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38143e70 0x7fbd381e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380bd810 con 0x7fbd38144830 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381e49e0 con 0x7fbd28003980 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38142e10 con 0x7fbd38143e70 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37286/0 (socket says 172.21.15.27:37286) 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 -- 172.21.15.27:0/1205930201 learned_addr learned my addr 172.21.15.27:0/1205930201 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd37fff640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38143e70 0x7fbd381e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28003980 0x7fbd380bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 -- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38143e70 msgr2=0x7fbd381e44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38143e70 0x7fbd381e44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 -- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28003980 msgr2=0x7fbd380bd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28003980 0x7fbd380bd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 -- 172.21.15.27:0/1205930201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38142850 con 0x7fbd38144830 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3d070640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd3806bed0 tx=0x7fbd3000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30016620 con 0x7fbd38144830 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30016780 con 0x7fbd38144830 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd38142b30 con 0x7fbd38144830 2024-01-24T14:01:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30016b10 con 0x7fbd38144830 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd38143a20 con 0x7fbd38144830 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38144550 con 0x7fbd38144830 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.069+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd30016c70 con 0x7fbd38144830 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.073+0000 7fbd357fa640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 0x7fbd1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.073+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd30083c30 con 0x7fbd38144830 2024-01-24T14:01:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.073+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 0x7fbd1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.073+0000 7fbd3c86f640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 0x7fbd1c067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd240ad000 tx=0x7fbd240046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.077+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7fbd38144550 con 0x7fbd38144830 2024-01-24T14:01:21.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.225+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd38144550 con 0x7fbd1c065a60 2024-01-24T14:01:21.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.225+0000 7fbd357fa640 1 -- 172.21.15.27:0/1205930201 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd38144550 con 0x7fbd1c065a60 2024-01-24T14:01:21.229 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 2 to deep-scrub 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 msgr2=0x7fbd1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 0x7fbd1c067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd240ad000 tx=0x7fbd240046d0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 msgr2=0x7fbd38139230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd3806bed0 tx=0x7fbd3000f520 comp rx=0 tx=0).stop 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 shutdown_connections 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7fbd1c065a60 0x7fbd1c067f20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd38144830 0x7fbd38139230 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7fbd38143e70 0x7fbd381e44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 --2- 172.21.15.27:0/1205930201 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7fbd28003980 0x7fbd380bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 >> 172.21.15.27:0/1205930201 conn(0x7fbd3806ae30 msgr2=0x7fbd3813c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 shutdown_connections 2024-01-24T14:01:21.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.229+0000 7fbd3ead3640 1 -- 172.21.15.27:0/1205930201 wait complete. 2024-01-24T14:01:21.247 INFO:tasks.ceph:Scrubbing osd.3 2024-01-24T14:01:21.247 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:21.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 Processor -- start 2024-01-24T14:01:21.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 -- start start 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4d9c0b6880 0x7f4d9c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 0x7f4d9c142720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b3e60 0x7f4d9c069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b8e50 con 0x7f4d9c0b6880 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b7df0 con 0x7f4d9c0b9270 2024-01-24T14:01:21.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da2daf640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c0b8070 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da0b4b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4d9c0b6880 0x7f4d9c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da0b4b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4d9c0b6880 0x7f4d9c14bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37302/0 (socket says 172.21.15.27:37302) 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.361+0000 7f4da0b4b640 1 -- 172.21.15.27:0/3015354017 learned_addr learned my addr 172.21.15.27:0/3015354017 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4d9bfff640 1 --2- 172.21.15.27:0/3015354017 >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 0x7f4d9c142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 -- 172.21.15.27:0/3015354017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b3e60 msgr2=0x7f4d9c069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/3015354017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b3e60 0x7f4d9c069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 -- 172.21.15.27:0/3015354017 >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 msgr2=0x7f4d9c142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/3015354017 >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 0x7f4d9c142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 -- 172.21.15.27:0/3015354017 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0b8a70 con 0x7f4d9c0b6880 2024-01-24T14:01:21.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4d9bfff640 1 --2- 172.21.15.27:0/3015354017 >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 0x7f4d9c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:21.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/3015354017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b6880 0x7f4d9c14bc90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c149760 tx=0x7f4d9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4237dc8dbc6710 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4d9b7fe640 1 -- 172.21.15.27:0/3015354017 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900ab650 con 0x7f4d9c0b6880 2024-01-24T14:01:21.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4d9b7fe640 1 -- 172.21.15.27:0/3015354017 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d900ab7b0 con 0x7f4d9c0b6880 2024-01-24T14:01:21.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4d9b7fe640 1 -- 172.21.15.27:0/3015354017 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900abb40 con 0x7f4d9c0b6880 2024-01-24T14:01:21.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 -- 172.21.15.27:0/3015354017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b6880 msgr2=0x7f4d9c14bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 --2- 172.21.15.27:0/3015354017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b6880 0x7f4d9c14bc90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c149760 tx=0x7f4d9001c470 comp rx=0 tx=0).stop 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 -- 172.21.15.27:0/3015354017 shutdown_connections 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 --2- 172.21.15.27:0/3015354017 >> v2:172.21.15.124:3300/0 conn(0x7f4d9c0b9270 0x7f4d9c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 --2- 172.21.15.27:0/3015354017 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b3e60 0x7f4d9c069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 --2- 172.21.15.27:0/3015354017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b6880 0x7f4d9c14bc90 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 -- 172.21.15.27:0/3015354017 >> 172.21.15.27:0/3015354017 conn(0x7f4d9c0bcf70 msgr2=0x7f4d9c0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 -- 172.21.15.27:0/3015354017 shutdown_connections 2024-01-24T14:01:21.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.365+0000 7f4da2daf640 1 -- 172.21.15.27:0/3015354017 wait complete. 2024-01-24T14:01:21.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 Processor -- start 2024-01-24T14:01:21.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- start start 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 0x7f4d9c13b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b6880 0x7f4d9c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d9c0b9270 0x7f4d9c0b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c13bf20 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c148b10 con 0x7f4d9c0b9270 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c148df0 con 0x7f4d9c0b6880 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 0x7f4d9c13b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 0x7f4d9c13b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37314/0 (socket says 172.21.15.27:37314) 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 -- 172.21.15.27:0/2749974645 learned_addr learned my addr 172.21.15.27:0/2749974645 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d9bfff640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b6880 0x7f4d9c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da134c640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d9c0b9270 0x7f4d9c0b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 -- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b6880 msgr2=0x7f4d9c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f4d9c0b6880 0x7f4d9c146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 -- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d9c0b9270 msgr2=0x7f4d9c0b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4d9c0b9270 0x7f4d9c0b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900094d0 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da0b4b640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 0x7f4d9c13b9e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4d900ad040 tx=0x7f4d9001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900b4800 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d900b4960 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c1490d0 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900b4d10 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c133760 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d9c142c60 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d900c7390 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4d80065a60 0x7f4d80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d9011dc80 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7f4d8006b8c0 0x7f4d8006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d8006e390 con 0x7f4d8006b8c0 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d90120340 con 0x7f4d9c0b3e60 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4d9bfff640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4d80065a60 0x7f4d80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da134c640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7f4d8006b8c0 0x7f4d8006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.369+0000 7f4da134c640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7f4d8006b8c0 0x7f4d8006dce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.373+0000 7f4d9bfff640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4d80065a60 0x7f4d80067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d88006fd0 tx=0x7f4d88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.373+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== osd.3 v2:172.21.15.27:6800/27568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d8006e390 con 0x7f4d8006b8c0 2024-01-24T14:01:21.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.393+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 --> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d9c148c50 con 0x7f4d8006b8c0 2024-01-24T14:01:21.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.393+0000 7f4d997fa640 1 -- 172.21.15.27:0/2749974645 <== osd.3 v2:172.21.15.27:6800/27568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d9c148c50 con 0x7f4d8006b8c0 2024-01-24T14:01:21.397 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:21.398 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:21.398 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.393+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7f4d8006b8c0 msgr2=0x7f4d8006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.393+0000 7f4da2daf640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:6800/27568,v1:172.21.15.27:6801/27568] conn(0x7f4d8006b8c0 0x7f4d8006dce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4d80065a60 msgr2=0x7f4d80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4d80065a60 0x7f4d80067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d88006fd0 tx=0x7f4d88008040 comp rx=0 tx=0).stop 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 msgr2=0x7f4d9c13b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 --2- 172.21.15.27:0/2749974645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d9c0b3e60 0x7f4d9c13b9e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4d900ad040 tx=0x7f4d9001acb0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da134c640 1 -- 172.21.15.27:0/2749974645 reap_dead start 2024-01-24T14:01:21.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 shutdown_connections 2024-01-24T14:01:21.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 >> 172.21.15.27:0/2749974645 conn(0x7f4d9c0bcf70 msgr2=0x7f4d9c141750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 shutdown_connections 2024-01-24T14:01:21.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.397+0000 7f4da2daf640 1 -- 172.21.15.27:0/2749974645 wait complete. 2024-01-24T14:01:21.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-24T14:01:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 Processor -- start 2024-01-24T14:01:21.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 -- start start 2024-01-24T14:01:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc071160 0x7f7adc0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f7adc0b42d0 0x7f7adc0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7adc1429f0 0x7f7adc14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0b5140 con 0x7f7adc1429f0 2024-01-24T14:01:21.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0b3c40 con 0x7f7adc0b42d0 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae24bb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b4710 con 0x7f7adc071160 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae0a58640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7adc1429f0 0x7f7adc14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae0a58640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7adc1429f0 0x7f7adc14bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37320/0 (socket says 172.21.15.27:37320) 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.517+0000 7f7ae0a58640 1 -- 172.21.15.27:0/2582956794 learned_addr learned my addr 172.21.15.27:0/2582956794 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7adb7fe640 1 --2- 172.21.15.27:0/2582956794 >> v2:172.21.15.124:3300/0 conn(0x7f7adc0b42d0 0x7f7adc0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7adbfff640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc071160 0x7f7adc0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 -- 172.21.15.27:0/2582956794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc071160 msgr2=0x7f7adc0b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc071160 0x7f7adc0b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 -- 172.21.15.27:0/2582956794 >> v2:172.21.15.124:3300/0 conn(0x7f7adc0b42d0 msgr2=0x7f7adc0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 --2- 172.21.15.27:0/2582956794 >> v2:172.21.15.124:3300/0 conn(0x7f7adc0b42d0 0x7f7adc0b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 -- 172.21.15.27:0/2582956794 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0b9f60 con 0x7f7adc1429f0 2024-01-24T14:01:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae0a58640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc1429f0 0x7f7adc14bf30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0bf250 tx=0x7f7ad401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bef2416729956e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7adaffd640 1 -- 172.21.15.27:0/2582956794 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a5820 con 0x7f7adc1429f0 2024-01-24T14:01:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7adaffd640 1 -- 172.21.15.27:0/2582956794 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad40a5980 con 0x7f7adc1429f0 2024-01-24T14:01:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7adaffd640 1 -- 172.21.15.27:0/2582956794 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a5d10 con 0x7f7adc1429f0 2024-01-24T14:01:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2582956794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc1429f0 msgr2=0x7f7adc14bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc1429f0 0x7f7adc14bf30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0bf250 tx=0x7f7ad401c9a0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2582956794 shutdown_connections 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2582956794 >> v2:172.21.15.124:3300/0 conn(0x7f7adc0b42d0 0x7f7adc0b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc1429f0 0x7f7adc14bf30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2582956794 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc071160 0x7f7adc0b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2582956794 >> 172.21.15.27:0/2582956794 conn(0x7f7adc0be150 msgr2=0x7f7adc0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2582956794 shutdown_connections 2024-01-24T14:01:21.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.521+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2582956794 wait complete. 2024-01-24T14:01:21.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 Processor -- start 2024-01-24T14:01:21.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- start start 2024-01-24T14:01:21.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc0b42d0 0x7f7adc151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 0x7f7adc1e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc1529e0 con 0x7f7adc071160 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc06ca30 con 0x7f7adc1429f0 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc06cd10 con 0x7f7adc0b42d0 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37330/0 (socket says 172.21.15.27:37330) 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 -- 172.21.15.27:0/2603051342 learned_addr learned my addr 172.21.15.27:0/2603051342 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae0a58640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 0x7f7adc1e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adb7fe640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc0b42d0 0x7f7adc151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 -- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc0b42d0 msgr2=0x7f7adc151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc0b42d0 0x7f7adc151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 -- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 msgr2=0x7f7adc1e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 0x7f7adc1e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 -- 172.21.15.27:0/2603051342 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4009b30 con 0x7f7adc071160 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae0a58640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 0x7f7adc1e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7adbfff640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d800 tx=0x7f7acc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0096c0 con 0x7f7adc071160 2024-01-24T14:01:21.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc009820 con 0x7f7adc071160 2024-01-24T14:01:21.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc009bd0 con 0x7f7adc071160 2024-01-24T14:01:21.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc13d690 con 0x7f7adc071160 2024-01-24T14:01:21.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc06bfb0 con 0x7f7adc071160 2024-01-24T14:01:21.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.525+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc06c870 con 0x7f7adc071160 2024-01-24T14:01:21.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.529+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7acc009d30 con 0x7f7adc071160 2024-01-24T14:01:21.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.529+0000 7f7ad8ff9640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 0x7f7ac8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.529+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7acc0835c0 con 0x7f7adc071160 2024-01-24T14:01:21.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.529+0000 7f7adb7fe640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 0x7f7ac8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.529+0000 7f7adb7fe640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 0x7f7ac8067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7adc142640 tx=0x7f7ad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.533+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f7acc051310 con 0x7f7adc071160 2024-01-24T14:01:21.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.681+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7adc06cba0 con 0x7f7ac8065a60 2024-01-24T14:01:21.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ad8ff9640 1 -- 172.21.15.27:0/2603051342 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7adc06cba0 con 0x7f7ac8065a60 2024-01-24T14:01:21.686 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 3 to deep-scrub 2024-01-24T14:01:21.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 msgr2=0x7f7ac8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 0x7f7ac8067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7adc142640 tx=0x7f7ad0008040 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 msgr2=0x7f7adc13d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d800 tx=0x7f7acc00dcc0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 shutdown_connections 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7ac8065a60 0x7f7ac8067f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f7adc1429f0 0x7f7adc1e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7adc0b42d0 0x7f7adc151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 --2- 172.21.15.27:0/2603051342 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7adc071160 0x7f7adc13d150 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 >> 172.21.15.27:0/2603051342 conn(0x7f7adc0be150 msgr2=0x7f7adc0b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 shutdown_connections 2024-01-24T14:01:21.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.685+0000 7f7ae24bb640 1 -- 172.21.15.27:0/2603051342 wait complete. 2024-01-24T14:01:21.704 INFO:tasks.ceph:Scrubbing osd.4 2024-01-24T14:01:21.704 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:21.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 Processor -- start 2024-01-24T14:01:21.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 -- start start 2024-01-24T14:01:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7feb80069f80 0x7feb800b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb8006fc40 0x7feb801447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800b82e0 con 0x7feb8014dea0 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800700b0 con 0x7feb8006fc40 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb860f4640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb80070380 con 0x7feb80069f80 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb8006fc40 0x7feb801447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7effd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feb8014dea0 0x7feb800b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59628/0 (socket says 172.21.15.27:59628) 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7effd640 1 -- 172.21.15.27:0/2371579425 learned_addr learned my addr 172.21.15.27:0/2371579425 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7f7fe640 1 --2- 172.21.15.27:0/2371579425 >> v2:172.21.15.124:3300/0 conn(0x7feb80069f80 0x7feb800b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7ffff640 1 -- 172.21.15.27:0/2371579425 >> v2:172.21.15.124:3300/0 conn(0x7feb80069f80 msgr2=0x7feb800b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7ffff640 1 --2- 172.21.15.27:0/2371579425 >> v2:172.21.15.124:3300/0 conn(0x7feb80069f80 0x7feb800b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7ffff640 1 -- 172.21.15.27:0/2371579425 >> v1:172.21.15.27:6789/0 conn(0x7feb8014dea0 legacy=0x7feb800b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7e7fc640 1 -- 172.21.15.27:0/2371579425 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077922623 0 0) 0x7feb800b82e0 con 0x7feb8014dea0 2024-01-24T14:01:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.817+0000 7feb7ffff640 1 -- 172.21.15.27:0/2371579425 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80070660 con 0x7feb8006fc40 2024-01-24T14:01:21.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7ffff640 1 --2- 172.21.15.27:0/2371579425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb801447d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7feb80066080 tx=0x7feb7801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e8511456a65c8e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7e7fc640 1 -- 172.21.15.27:0/2371579425 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780b0440 con 0x7feb8006fc40 2024-01-24T14:01:21.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7e7fc640 1 -- 172.21.15.27:0/2371579425 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780b05a0 con 0x7feb8006fc40 2024-01-24T14:01:21.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7e7fc640 1 -- 172.21.15.27:0/2371579425 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780b0930 con 0x7feb8006fc40 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/2371579425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 msgr2=0x7feb801447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- 172.21.15.27:0/2371579425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb801447d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7feb80066080 tx=0x7feb7801f0f0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/2371579425 shutdown_connections 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- 172.21.15.27:0/2371579425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb801447d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- 172.21.15.27:0/2371579425 >> v2:172.21.15.124:3300/0 conn(0x7feb80069f80 0x7feb800b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/2371579425 >> 172.21.15.27:0/2371579425 conn(0x7feb800bcf70 msgr2=0x7feb800bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/2371579425 shutdown_connections 2024-01-24T14:01:21.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/2371579425 wait complete. 2024-01-24T14:01:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 Processor -- start 2024-01-24T14:01:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- start start 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feb80069f80 0x7feb800ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb80139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feb8014dea0 0x7feb800bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800ba860 con 0x7feb8006fc40 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb801441a0 con 0x7feb80069f80 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb801e2fa0 con 0x7feb8014dea0 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb80139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb80139d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37344/0 (socket says 172.21.15.27:37344) 2024-01-24T14:01:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 -- 172.21.15.27:0/4256706485 learned_addr learned my addr 172.21.15.27:0/4256706485 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 -- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feb8014dea0 msgr2=0x7feb800bbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7feb8014dea0 0x7feb800bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 -- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feb80069f80 msgr2=0x7feb800ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7feb80069f80 0x7feb800ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009a70 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb7effd640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb80139d70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7feb7400c450 tx=0x7feb7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740074e0 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb80142400 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74007640 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740049f0 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.821+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb80143e30 con 0x7feb8006fc40 2024-01-24T14:01:21.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb8006a360 con 0x7feb8006fc40 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb7401b360 con 0x7feb8006fc40 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7feb6c065a90 0x7feb6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb74082220 con 0x7feb8006fc40 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7feb6c06b8f0 0x7feb6c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb6c06e3c0 con 0x7feb6c06b8f0 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb74082670 con 0x7feb8006fc40 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb7f7fe640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7feb6c065a90 0x7feb6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb7ffff640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7feb6c06b8f0 0x7feb6c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb7ffff640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7feb6c06b8f0 0x7feb6c06dd10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.825+0000 7feb7f7fe640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7feb6c065a90 0x7feb6c067f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb700098f0 tx=0x7feb70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.829+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== osd.4 v2:172.21.15.124:6804/27688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7feb6c06e3c0 con 0x7feb6c06b8f0 2024-01-24T14:01:21.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 --> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feb800b7f70 con 0x7feb6c06b8f0 2024-01-24T14:01:21.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb67fff640 1 -- 172.21.15.27:0/4256706485 <== osd.4 v2:172.21.15.124:6804/27688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7feb78009450 con 0x7feb6c06b8f0 2024-01-24T14:01:21.843 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:21.843 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:21.843 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7feb6c06b8f0 msgr2=0x7feb6c06dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6804/27688,v1:172.21.15.124:6805/27688] conn(0x7feb6c06b8f0 0x7feb6c06dd10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7feb6c065a90 msgr2=0x7feb6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7feb6c065a90 0x7feb6c067f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb700098f0 tx=0x7feb70008040 comp rx=0 tx=0).stop 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 msgr2=0x7feb80139d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 --2- 172.21.15.27:0/4256706485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb8006fc40 0x7feb80139d70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7feb7400c450 tx=0x7feb7400c910 comp rx=0 tx=0).stop 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb7ffff640 1 -- 172.21.15.27:0/4256706485 reap_dead start 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 shutdown_connections 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 >> 172.21.15.27:0/4256706485 conn(0x7feb800bcf70 msgr2=0x7feb80073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 shutdown_connections 2024-01-24T14:01:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.841+0000 7feb860f4640 1 -- 172.21.15.27:0/4256706485 wait complete. 2024-01-24T14:01:21.860 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-24T14:01:21.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 Processor -- start 2024-01-24T14:01:21.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 -- start start 2024-01-24T14:01:21.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7efcf814b540 0x7efcf80bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efcf814dfd0 0x7efcf814e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf806ae40 con 0x7efcf814dfd0 2024-01-24T14:01:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80bc320 con 0x7efcf814b540 2024-01-24T14:01:21.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efd003c5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80bb650 con 0x7efcf806a4c0 2024-01-24T14:01:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efcf814dfd0 0x7efcf814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efcf814dfd0 0x7efcf814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37348/0 (socket says 172.21.15.27:37348) 2024-01-24T14:01:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 -- 172.21.15.27:0/2929189286 learned_addr learned my addr 172.21.15.27:0/2929189286 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfd960640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe161640 1 --2- 172.21.15.27:0/2929189286 >> v2:172.21.15.124:3300/0 conn(0x7efcf814b540 0x7efcf80bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 -- 172.21.15.27:0/2929189286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 msgr2=0x7efcf806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 -- 172.21.15.27:0/2929189286 >> v2:172.21.15.124:3300/0 conn(0x7efcf814b540 msgr2=0x7efcf80bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:21.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 --2- 172.21.15.27:0/2929189286 >> v2:172.21.15.124:3300/0 conn(0x7efcf814b540 0x7efcf80bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 -- 172.21.15.27:0/2929189286 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80bc590 con 0x7efcf814dfd0 2024-01-24T14:01:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfd960640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.965+0000 7efcfe962640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf814e440 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efcf80be590 tx=0x7efcf001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fe40b14e9ae283 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfd15f640 1 -- 172.21.15.27:0/2929189286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00af400 con 0x7efcf814dfd0 2024-01-24T14:01:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfd15f640 1 -- 172.21.15.27:0/2929189286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00ab050 con 0x7efcf814dfd0 2024-01-24T14:01:21.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfd15f640 1 -- 172.21.15.27:0/2929189286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00af780 con 0x7efcf814dfd0 2024-01-24T14:01:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/2929189286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 msgr2=0x7efcf814e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf814e440 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efcf80be590 tx=0x7efcf001f1c0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/2929189286 shutdown_connections 2024-01-24T14:01:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf814e440 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- 172.21.15.27:0/2929189286 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- 172.21.15.27:0/2929189286 >> v2:172.21.15.124:3300/0 conn(0x7efcf814b540 0x7efcf80bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/2929189286 >> 172.21.15.27:0/2929189286 conn(0x7efcf80c02e0 msgr2=0x7efcf80c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/2929189286 shutdown_connections 2024-01-24T14:01:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/2929189286 wait complete. 2024-01-24T14:01:21.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 Processor -- start 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- start start 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf81e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efcf814b540 0x7efcf81d3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81e32e0 con 0x7efcf814dfd0 2024-01-24T14:01:21.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80be740 con 0x7efcf814b540 2024-01-24T14:01:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81d4f30 con 0x7efcf806a4c0 2024-01-24T14:01:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37360/0 (socket says 172.21.15.27:37360) 2024-01-24T14:01:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 -- 172.21.15.27:0/4190714200 learned_addr learned my addr 172.21.15.27:0/4190714200 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfd960640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efcf814b540 0x7efcf81d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe161640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf81e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 -- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 msgr2=0x7efcf81e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf81e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 -- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efcf814b540 msgr2=0x7efcf81d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efcf814b540 0x7efcf81d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 -- 172.21.15.27:0/4190714200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009b30 con 0x7efcf814dfd0 2024-01-24T14:01:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efcfe962640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efcf001fa60 tx=0x7efcf001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00afde0 con 0x7efcf814dfd0 2024-01-24T14:01:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0009510 con 0x7efcf814dfd0 2024-01-24T14:01:21.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf81d5180 con 0x7efcf814dfd0 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00ba680 con 0x7efcf814dfd0 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.969+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf814cfe0 con 0x7efcf814dfd0 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf80bfcc0 con 0x7efcf814dfd0 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efcf00b6040 con 0x7efcf814dfd0 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efceeffd640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 0x7efcdc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efcf01211f0 con 0x7efcf814dfd0 2024-01-24T14:01:21.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efcfe161640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 0x7efcdc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:21.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.973+0000 7efcfe161640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 0x7efcdc067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a8f0 tx=0x7efcf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:21.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:21.977+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efcf80bfcc0 con 0x7efcf814dfd0 2024-01-24T14:01:22.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.129+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efcf80bfa00 con 0x7efcdc065a60 2024-01-24T14:01:22.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.129+0000 7efceeffd640 1 -- 172.21.15.27:0/4190714200 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efcf400c050 con 0x7efcdc065a60 2024-01-24T14:01:22.132 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 4 to deep-scrub 2024-01-24T14:01:22.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.129+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 msgr2=0x7efcdc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.129+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 0x7efcdc067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a8f0 tx=0x7efcf4008040 comp rx=0 tx=0).stop 2024-01-24T14:01:22.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.129+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 msgr2=0x7efcf80b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efcf001fa60 tx=0x7efcf001bf60 comp rx=0 tx=0).stop 2024-01-24T14:01:22.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 shutdown_connections 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efcdc065a60 0x7efcdc067f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efcf814dfd0 0x7efcf80b2a90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efcf814b540 0x7efcf81d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 --2- 172.21.15.27:0/4190714200 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efcf806a4c0 0x7efcf81e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 >> 172.21.15.27:0/4190714200 conn(0x7efcf80c02e0 msgr2=0x7efcf8149910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 shutdown_connections 2024-01-24T14:01:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.133+0000 7efd003c5640 1 -- 172.21.15.27:0/4190714200 wait complete. 2024-01-24T14:01:22.151 INFO:tasks.ceph:Scrubbing osd.5 2024-01-24T14:01:22.151 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:22.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 Processor -- start 2024-01-24T14:01:22.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 -- start start 2024-01-24T14:01:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f40480ba190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4048070cc0 0x7f4048142590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40480b8690 con 0x7f40480b6880 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480b9520 con 0x7f4048070cc0 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f404e076640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40480b80c0 con 0x7f40480b90e0 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4048070cc0 0x7f4048142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4048070cc0 0x7f4048142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37368/0 (socket says 172.21.15.27:37368) 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 -- 172.21.15.27:0/2129458772 learned_addr learned my addr 172.21.15.27:0/2129458772 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f40477fe640 1 --1- 172.21.15.27:0/2129458772 >> v1:172.21.15.124:6789/0 conn(0x7f40480b6880 0x7f40480b7910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.124:6789/0 says I am v1:172.21.15.27:39780/0 (socket says 172.21.15.27:39780) 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4046ffd640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f40480ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 -- 172.21.15.27:0/2129458772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 msgr2=0x7f40480ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f40480ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 -- 172.21.15.27:0/2129458772 >> v1:172.21.15.124:6789/0 conn(0x7f40480b6880 legacy=0x7f40480b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.269+0000 7f4047fff640 1 -- 172.21.15.27:0/2129458772 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480b88e0 con 0x7f4048070cc0 2024-01-24T14:01:22.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4047fff640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4048070cc0 0x7f4048142590 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4040009e50 tx=0x7f404001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f13abb16c8ccd85 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f40467fc640 1 -- 172.21.15.27:0/2129458772 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400a58d0 con 0x7f4048070cc0 2024-01-24T14:01:22.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f40467fc640 1 -- 172.21.15.27:0/2129458772 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400a5a30 con 0x7f4048070cc0 2024-01-24T14:01:22.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f40467fc640 1 -- 172.21.15.27:0/2129458772 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400a5dc0 con 0x7f4048070cc0 2024-01-24T14:01:22.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/2129458772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4048070cc0 msgr2=0x7f4048142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4048070cc0 0x7f4048142590 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4040009e50 tx=0x7f404001c9e0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/2129458772 shutdown_connections 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4048070cc0 0x7f4048142590 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- 172.21.15.27:0/2129458772 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f40480ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/2129458772 >> 172.21.15.27:0/2129458772 conn(0x7f40480bcf70 msgr2=0x7f40480bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/2129458772 shutdown_connections 2024-01-24T14:01:22.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/2129458772 wait complete. 2024-01-24T14:01:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 Processor -- start 2024-01-24T14:01:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- start start 2024-01-24T14:01:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4048070cc0 0x7f40481391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 0x7f404813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f4048136770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4048145890 con 0x7f40480b6880 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4048144ac0 con 0x7f4048070cc0 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4048139730 con 0x7f40480b90e0 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 0x7f404813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 0x7f404813f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37382/0 (socket says 172.21.15.27:37382) 2024-01-24T14:01:22.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 -- 172.21.15.27:0/395179881 learned_addr learned my addr 172.21.15.27:0/395179881 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f40477fe640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4048070cc0 0x7f40481391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4047fff640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f4048136770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 -- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 msgr2=0x7f4048136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f40480b90e0 0x7f4048136770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 -- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4048070cc0 msgr2=0x7f40481391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f4048070cc0 0x7f40481391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009b30 con 0x7f40480b6880 2024-01-24T14:01:22.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f4046ffd640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 0x7f404813f500 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f403000e960 tx=0x7f403000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030009690 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403000ca00 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4048071290 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.273+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000cd70 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4048144470 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4048071110 con 0x7f40480b6880 2024-01-24T14:01:22.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4030013470 con 0x7f40480b6880 2024-01-24T14:01:22.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4028065a90 0x7f4028067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4030083530 con 0x7f40480b6880 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f402806b8f0 0x7f402806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f402806e3c0 con 0x7f402806b8f0 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40300838a0 con 0x7f40480b6880 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f40477fe640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4028065a90 0x7f4028067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f4047fff640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f402806b8f0 0x7f402806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f40477fe640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4028065a90 0x7f4028067f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4038000f70 tx=0x7f4038007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.277+0000 7f4047fff640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f402806b8f0 0x7f402806dd10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.281+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== osd.5 v2:172.21.15.124:6816/27689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f402806e3c0 con 0x7f402806b8f0 2024-01-24T14:01:22.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 --> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40480b6c60 con 0x7f402806b8f0 2024-01-24T14:01:22.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f403ffff640 1 -- 172.21.15.27:0/395179881 <== osd.5 v2:172.21.15.124:6816/27689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4040009150 con 0x7f402806b8f0 2024-01-24T14:01:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:22.295 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:22.295 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:22.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f402806b8f0 msgr2=0x7f402806dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6816/27689,v1:172.21.15.124:6817/27689] conn(0x7f402806b8f0 0x7f402806dd10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4028065a90 msgr2=0x7f4028067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f4028065a90 0x7f4028067f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4038000f70 tx=0x7f4038007c90 comp rx=0 tx=0).stop 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 msgr2=0x7f404813f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 --2- 172.21.15.27:0/395179881 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40480b6880 0x7f404813f500 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f403000e960 tx=0x7f403000ee20 comp rx=0 tx=0).stop 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f4047fff640 1 -- 172.21.15.27:0/395179881 reap_dead start 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 shutdown_connections 2024-01-24T14:01:22.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 >> 172.21.15.27:0/395179881 conn(0x7f40480bcf70 msgr2=0x7f404806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 shutdown_connections 2024-01-24T14:01:22.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.293+0000 7f404e076640 1 -- 172.21.15.27:0/395179881 wait complete. 2024-01-24T14:01:22.311 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-24T14:01:22.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 Processor -- start 2024-01-24T14:01:22.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 -- start start 2024-01-24T14:01:22.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 0x7f06ac0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac14dfd0 0x7f06ac14e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac06ae40 con 0x7f06ac14dfd0 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0bc320 con 0x7f06ac14b540 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b2bfe640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0bb650 con 0x7f06ac06a4c0 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac14dfd0 0x7f06ac14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f06ac14dfd0 0x7f06ac14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37388/0 (socket says 172.21.15.27:37388) 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 -- 172.21.15.27:0/1471218324 learned_addr learned my addr 172.21.15.27:0/1471218324 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06abfff640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 -- 172.21.15.27:0/1471218324 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 msgr2=0x7f06ac06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:22.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b099a640 1 --2- 172.21.15.27:0/1471218324 >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 0x7f06ac0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 -- 172.21.15.27:0/1471218324 >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 msgr2=0x7f06ac0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:22.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 --2- 172.21.15.27:0/1471218324 >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 0x7f06ac0bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b119b640 1 -- 172.21.15.27:0/1471218324 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0bc590 con 0x7f06ac14dfd0 2024-01-24T14:01:22.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.417+0000 7f06b099a640 1 --2- 172.21.15.27:0/1471218324 >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 0x7f06ac0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:22.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b119b640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14dfd0 0x7f06ac14e440 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0be590 tx=0x7f06a401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c052bdedef27bea server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06ab7fe640 1 -- 172.21.15.27:0/1471218324 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a89b0 con 0x7f06ac14dfd0 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06ab7fe640 1 -- 172.21.15.27:0/1471218324 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40a8b10 con 0x7f06ac14dfd0 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06ab7fe640 1 -- 172.21.15.27:0/1471218324 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a8ea0 con 0x7f06ac14dfd0 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- 172.21.15.27:0/1471218324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14dfd0 msgr2=0x7f06ac14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14dfd0 0x7f06ac14e440 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0be590 tx=0x7f06a401ecf0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- 172.21.15.27:0/1471218324 shutdown_connections 2024-01-24T14:01:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14dfd0 0x7f06ac14e440 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/1471218324 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/1471218324 >> v2:172.21.15.124:3300/0 conn(0x7f06ac14b540 0x7f06ac0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- 172.21.15.27:0/1471218324 >> 172.21.15.27:0/1471218324 conn(0x7f06ac0c02e0 msgr2=0x7f06ac0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- 172.21.15.27:0/1471218324 shutdown_connections 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- 172.21.15.27:0/1471218324 wait complete. 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 Processor -- start 2024-01-24T14:01:22.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- start start 2024-01-24T14:01:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 0x7f06ac145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac14dc00 con 0x7f06ac14b540 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0a4600 con 0x7f06ac14dfd0 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06b2bfe640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0a4b80 con 0x7f06ac06a4c0 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37390/0 (socket says 172.21.15.27:37390) 2024-01-24T14:01:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.421+0000 7f06abfff640 1 -- 172.21.15.27:0/840046123 learned_addr learned my addr 172.21.15.27:0/840046123 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b119b640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 0x7f06ac145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b099a640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 -- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 msgr2=0x7f06ac14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 -- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 msgr2=0x7f06ac145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 0x7f06ac145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 -- 172.21.15.27:0/840046123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40094d0 con 0x7f06ac14b540 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b119b640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 0x7f06ac145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:22.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b099a640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06abfff640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c820 tx=0x7f06a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0004220 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00043a0 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0a5fd0 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0004510 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0b8ac0 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac0a57b0 con 0x7f06ac14b540 2024-01-24T14:01:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06a0007a70 con 0x7f06ac14b540 2024-01-24T14:01:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f06a0082b80 con 0x7f06ac14b540 2024-01-24T14:01:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b099a640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.425+0000 7f06b099a640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 0x7f0698067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f069c007f70 tx=0x7f069c0074c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.429+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f06ac0a57b0 con 0x7f06ac14b540 2024-01-24T14:01:22.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.577+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f06ac0b3a10 con 0x7f0698065a60 2024-01-24T14:01:22.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06a97fa640 1 -- 172.21.15.27:0/840046123 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f069c00b420 con 0x7f0698065a60 2024-01-24T14:01:22.582 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 5 to deep-scrub 2024-01-24T14:01:22.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 msgr2=0x7f0698067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 0x7f0698067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f069c007f70 tx=0x7f069c0074c0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 msgr2=0x7f06ac0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c820 tx=0x7f06a000cce0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 shutdown_connections 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f06ac14dfd0 0x7f06ac145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f06ac14b540 0x7f06ac0a5a90 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 --2- 172.21.15.27:0/840046123 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f06ac06a4c0 0x7f06ac14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 >> 172.21.15.27:0/840046123 conn(0x7f06ac0c02e0 msgr2=0x7f06ac149980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 shutdown_connections 2024-01-24T14:01:22.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.581+0000 7f06b2bfe640 1 -- 172.21.15.27:0/840046123 wait complete. 2024-01-24T14:01:22.600 INFO:tasks.ceph:Scrubbing osd.6 2024-01-24T14:01:22.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 Processor -- start 2024-01-24T14:01:22.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 -- start start 2024-01-24T14:01:22.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1334069f80 0x7f13340b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f133414dea0 0x7f133406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340b82e0 con 0x7f13340b8770 2024-01-24T14:01:22.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1334070180 con 0x7f133414dea0 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133a282640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1334070380 con 0x7f1334069f80 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f13337fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f133414dea0 0x7f133406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133881f640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f13340b8770 0x7f13341447d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59638/0 (socket says 172.21.15.27:59638) 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f133881f640 1 -- 172.21.15.27:0/1684216673 learned_addr learned my addr 172.21.15.27:0/1684216673 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f1333fff640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1334069f80 0x7f13340b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f1332ffd640 1 -- 172.21.15.27:0/1684216673 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538298899 0 0) 0x7f13340b82e0 con 0x7f13340b8770 2024-01-24T14:01:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f13337fe640 1 -- 172.21.15.27:0/1684216673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1334069f80 msgr2=0x7f13340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:22.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f13337fe640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1334069f80 0x7f13340b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f13337fe640 1 -- 172.21.15.27:0/1684216673 >> v1:172.21.15.27:6789/0 conn(0x7f13340b8770 legacy=0x7f13341447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.717+0000 7f13337fe640 1 -- 172.21.15.27:0/1684216673 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334070660 con 0x7f133414dea0 2024-01-24T14:01:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f13337fe640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f133414dea0 0x7f133406fc40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f13280097c0 tx=0x7f132801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5758eca1c10724e server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1332ffd640 1 -- 172.21.15.27:0/1684216673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280a8970 con 0x7f133414dea0 2024-01-24T14:01:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1332ffd640 1 -- 172.21.15.27:0/1684216673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280a8ad0 con 0x7f133414dea0 2024-01-24T14:01:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1332ffd640 1 -- 172.21.15.27:0/1684216673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280a8e60 con 0x7f133414dea0 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/1684216673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f133414dea0 msgr2=0x7f133406fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f133414dea0 0x7f133406fc40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f13280097c0 tx=0x7f132801ec70 comp rx=0 tx=0).stop 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/1684216673 shutdown_connections 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f133414dea0 0x7f133406fc40 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- 172.21.15.27:0/1684216673 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f1334069f80 0x7f13340b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/1684216673 >> 172.21.15.27:0/1684216673 conn(0x7f13340bcf70 msgr2=0x7f13340bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/1684216673 shutdown_connections 2024-01-24T14:01:22.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/1684216673 wait complete. 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 Processor -- start 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- start start 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 0x7f1334146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f13340b8770 0x7f1334143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f133414dea0 0x7f1334144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334147030 con 0x7f1334069f80 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334143970 con 0x7f133414dea0 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13341e35c0 con 0x7f13340b8770 2024-01-24T14:01:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 0x7f1334146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 0x7f1334146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37400/0 (socket says 172.21.15.27:37400) 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 -- 172.21.15.27:0/2823468531 learned_addr learned my addr 172.21.15.27:0/2823468531 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 -- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f13340b8770 msgr2=0x7f1334143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f13340b8770 0x7f1334143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 -- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f133414dea0 msgr2=0x7f1334144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f133414dea0 0x7f1334144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328009420 con 0x7f1334069f80 2024-01-24T14:01:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1333fff640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 0x7f1334146af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f132400d830 tx=0x7f132400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400b6c0 con 0x7f1334069f80 2024-01-24T14:01:22.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400b820 con 0x7f1334069f80 2024-01-24T14:01:22.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1334146480 con 0x7f1334069f80 2024-01-24T14:01:22.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400bb90 con 0x7f1334069f80 2024-01-24T14:01:22.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.721+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13340bc450 con 0x7f1334069f80 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f133406a360 con 0x7f1334069f80 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f132401e460 con 0x7f1334069f80 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1320065a60 0x7f1320067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13240835e0 con 0x7f1334069f80 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7f132006b8c0 0x7f132006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f132006e390 con 0x7f132006b8c0 2024-01-24T14:01:22.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1324085ca0 con 0x7f1334069f80 2024-01-24T14:01:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f13337fe640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1320065a60 0x7f1320067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f133881f640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7f132006b8c0 0x7f132006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f13337fe640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1320065a60 0x7f1320067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13280b2000 tx=0x7f1328004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.725+0000 7f133881f640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7f132006b8c0 0x7f132006dce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.729+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== osd.6 v2:172.21.15.124:6824/27690 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f132006e390 con 0x7f132006b8c0 2024-01-24T14:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 --> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13340b7f70 con 0x7f132006b8c0 2024-01-24T14:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f1330ff9640 1 -- 172.21.15.27:0/2823468531 <== osd.6 v2:172.21.15.124:6824/27690 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f132c001980 con 0x7f132006b8c0 2024-01-24T14:01:22.742 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:22.743 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:22.743 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7f132006b8c0 msgr2=0x7f132006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6824/27690,v1:172.21.15.124:6825/27690] conn(0x7f132006b8c0 0x7f132006dce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1320065a60 msgr2=0x7f1320067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f1320065a60 0x7f1320067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f13280b2000 tx=0x7f1328004740 comp rx=0 tx=0).stop 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 msgr2=0x7f1334146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 --2- 172.21.15.27:0/2823468531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1334069f80 0x7f1334146af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f132400d830 tx=0x7f132400dcf0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133881f640 1 -- 172.21.15.27:0/2823468531 reap_dead start 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 shutdown_connections 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 >> 172.21.15.27:0/2823468531 conn(0x7f13340bcf70 msgr2=0x7f133413e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 shutdown_connections 2024-01-24T14:01:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.741+0000 7f133a282640 1 -- 172.21.15.27:0/2823468531 wait complete. 2024-01-24T14:01:22.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-24T14:01:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 Processor -- start 2024-01-24T14:01:22.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 -- start start 2024-01-24T14:01:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20cc0b6880 0x7f20cc14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc06fed0 con 0x7f20cc0b9270 2024-01-24T14:01:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0b8de0 con 0x7f20cc0b3e40 2024-01-24T14:01:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d41e9640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0b8ae0 con 0x7f20cc0b6880 2024-01-24T14:01:22.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1784640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f20cc0b9270 0x7f20cc142680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59644/0 (socket says 172.21.15.27:59644) 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1f85640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f20cc0b6880 0x7f20cc14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1784640 1 -- 172.21.15.27:0/2622890753 learned_addr learned my addr 172.21.15.27:0/2622890753 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1f85640 1 -- 172.21.15.27:0/2622890753 >> v1:172.21.15.124:6789/0 conn(0x7f20cc0b3e40 legacy=0x7f20cc153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1f85640 1 -- 172.21.15.27:0/2622890753 >> v1:172.21.15.27:6789/0 conn(0x7f20cc0b9270 legacy=0x7f20cc142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d1f85640 1 -- 172.21.15.27:0/2622890753 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0b7d30 con 0x7f20cc0b6880 2024-01-24T14:01:22.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.865+0000 7f20d0f83640 1 -- 172.21.15.27:0/2622890753 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887538430 0 0) 0x7f20bc001120 con 0x7f20cc0b9270 2024-01-24T14:01:22.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- 172.21.15.27:0/2622890753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b6880 0x7f20cc14bcf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f20c80097c0 tx=0x7f20c801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b29b992341f1af server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d0f83640 1 -- 172.21.15.27:0/2622890753 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80ab660 con 0x7f20cc0b6880 2024-01-24T14:01:22.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d0f83640 1 -- 172.21.15.27:0/2622890753 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80ab7c0 con 0x7f20cc0b6880 2024-01-24T14:01:22.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d0f83640 1 -- 172.21.15.27:0/2622890753 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80abb50 con 0x7f20cc0b6880 2024-01-24T14:01:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2622890753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b6880 msgr2=0x7f20cc14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2622890753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b6880 0x7f20cc14bcf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f20c80097c0 tx=0x7f20c801c440 comp rx=0 tx=0).stop 2024-01-24T14:01:22.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2622890753 shutdown_connections 2024-01-24T14:01:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2622890753 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b6880 0x7f20cc14bcf0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2622890753 >> 172.21.15.27:0/2622890753 conn(0x7f20cc06ae30 msgr2=0x7f20cc06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2622890753 shutdown_connections 2024-01-24T14:01:22.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2622890753 wait complete. 2024-01-24T14:01:22.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 Processor -- start 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- start start 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20cc0b6880 0x7f20cc1e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f20cc1e4990 0x7f20cc144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1e4560 con 0x7f20cc0b3e40 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc141070 con 0x7f20cc0b6880 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1412c0 con 0x7f20cc1e4990 2024-01-24T14:01:22.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37426/0 (socket says 172.21.15.27:37426) 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 -- 172.21.15.27:0/2129718967 learned_addr learned my addr 172.21.15.27:0/2129718967 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 -- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f20cc1e4990 msgr2=0x7f20cc144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f20cc1e4990 0x7f20cc144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 -- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20cc0b6880 msgr2=0x7f20cc1e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20cc0b6880 0x7f20cc1e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 -- 172.21.15.27:0/2129718967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009420 con 0x7f20cc0b3e40 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d1f85640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f20c8019050 tx=0x7f20c801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80b5810 con 0x7f20cc0b3e40 2024-01-24T14:01:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80b5970 con 0x7f20cc0b3e40 2024-01-24T14:01:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80b5d20 con 0x7f20cc0b3e40 2024-01-24T14:01:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.869+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc14c3b0 con 0x7f20cc0b3e40 2024-01-24T14:01:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc1447e0 con 0x7f20cc0b3e40 2024-01-24T14:01:22.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc1e46b0 con 0x7f20cc0b3e40 2024-01-24T14:01:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f20c80a9070 con 0x7f20cc0b3e40 2024-01-24T14:01:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20c27fc640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 0x7f20b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f20c811d8e0 con 0x7f20cc0b3e40 2024-01-24T14:01:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20d1784640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 0x7f20b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:22.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.873+0000 7f20d1784640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 0x7f20b0067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f20cc145d70 tx=0x7f20bc007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:22.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:22.877+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f20c80eb710 con 0x7f20cc0b3e40 2024-01-24T14:01:23.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.029+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f20cc14c230 con 0x7f20b0065a60 2024-01-24T14:01:23.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.029+0000 7f20c27fc640 1 -- 172.21.15.27:0/2129718967 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f20bc0070d0 con 0x7f20b0065a60 2024-01-24T14:01:23.032 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 6 to deep-scrub 2024-01-24T14:01:23.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.029+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 msgr2=0x7f20b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 0x7f20b0067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f20cc145d70 tx=0x7f20bc007970 comp rx=0 tx=0).stop 2024-01-24T14:01:23.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 msgr2=0x7f20cc13e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f20c8019050 tx=0x7f20c801ac80 comp rx=0 tx=0).stop 2024-01-24T14:01:23.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 shutdown_connections 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f20b0065a60 0x7f20b0067f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f20cc1e4990 0x7f20cc144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f20cc0b6880 0x7f20cc1e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 --2- 172.21.15.27:0/2129718967 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20cc0b3e40 0x7f20cc13e8e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 >> 172.21.15.27:0/2129718967 conn(0x7f20cc06ae30 msgr2=0x7f20cc0bb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 shutdown_connections 2024-01-24T14:01:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.033+0000 7f20d41e9640 1 -- 172.21.15.27:0/2129718967 wait complete. 2024-01-24T14:01:23.049 INFO:tasks.ceph:Scrubbing osd.7 2024-01-24T14:01:23.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-24T14:01:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 Processor -- start 2024-01-24T14:01:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 -- start start 2024-01-24T14:01:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f768c0b9b50 0x7f768c0b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c06fc40 con 0x7f768c147640 2024-01-24T14:01:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c06ff20 con 0x7f768c0b3dd0 2024-01-24T14:01:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f76940ab640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c0706d0 con 0x7f768c0b9b50 2024-01-24T14:01:23.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7691646640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f768c147640 0x7f768c1414f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59650/0 (socket says 172.21.15.27:59650) 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7691646640 1 -- 172.21.15.27:0/1644853965 learned_addr learned my addr 172.21.15.27:0/1644853965 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7691e47640 1 --2- 172.21.15.27:0/1644853965 >> v2:172.21.15.124:3300/0 conn(0x7f768c0b9b50 0x7f768c0b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137140855 0 0) 0x7f768c06fc40 con 0x7f768c147640 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7678003530 con 0x7f768c147640 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181469151 0 0) 0x7f7678003530 con 0x7f768c147640 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 >> v2:172.21.15.124:3300/0 conn(0x7f768c0b9b50 msgr2=0x7f768c0b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 --2- 172.21.15.27:0/1644853965 >> v2:172.21.15.124:3300/0 conn(0x7f768c0b9b50 0x7f768c0b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 >> v1:172.21.15.124:6789/0 conn(0x7f768c0b3dd0 legacy=0x7f768c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c070200 con 0x7f768c147640 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f767c001680 con 0x7f768c147640 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 >> v1:172.21.15.27:6789/0 conn(0x7f768c147640 legacy=0x7f768c1414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7678003980 0x7f7678003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76780047d0 0x7f7678004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f767800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767800c000 con 0x7f7678005190 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767800c170 con 0x7f76780047d0 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767800c330 con 0x7f7678003980 2024-01-24T14:01:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f767800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7691e47640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7678003980 0x7f7678003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7691646640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76780047d0 0x7f7678004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 -- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7678003980 msgr2=0x7f7678003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f7678003980 0x7f7678003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 -- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76780047d0 msgr2=0x7f7678004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f76780047d0 0x7f7678004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.169+0000 7f7692648640 1 -- 172.21.15.27:0/1644853965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678003530 con 0x7f7678005190 2024-01-24T14:01:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f7692648640 1 -- 172.21.15.27:0/1644853965 reap_dead start 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f7692648640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f767800b990 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7688001780 tx=0x7f768801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b23c4fb26260de1 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76880052d0 con 0x7f7678005190 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76880a7050 con 0x7f7678005190 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f7690e45640 1 -- 172.21.15.27:0/1644853965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688003840 con 0x7f7678005190 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 -- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 msgr2=0x7f767800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f767800b990 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7688001780 tx=0x7f768801c400 comp rx=0 tx=0).stop 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 -- 172.21.15.27:0/1644853965 shutdown_connections 2024-01-24T14:01:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 --2- 172.21.15.27:0/1644853965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f767800b990 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 -- 172.21.15.27:0/1644853965 >> 172.21.15.27:0/1644853965 conn(0x7f768c0bcf70 msgr2=0x7f768c0bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 -- 172.21.15.27:0/1644853965 shutdown_connections 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.173+0000 7f76940ab640 1 -- 172.21.15.27:0/1644853965 wait complete. 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 Processor -- start 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- start start 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f768c14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f768c144730 0x7f768c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f768c069d20 0x7f768c06a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c14af40 con 0x7f7678005190 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1409e0 con 0x7f768c144730 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c144bc0 con 0x7f768c069d20 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f768c14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f768c14aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37444/0 (socket says 172.21.15.27:37444) 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 -- 172.21.15.27:0/1747983857 learned_addr learned my addr 172.21.15.27:0/1747983857 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7692648640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f768c069d20 0x7f768c06a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691646640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f768c144730 0x7f768c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 -- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f768c069d20 msgr2=0x7f768c06a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f768c069d20 0x7f768c06a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 -- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f768c144730 msgr2=0x7f768c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f768c144730 0x7f768c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c140200 con 0x7f7678005190 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691646640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f768c144730 0x7f768c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7692648640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f768c069d20 0x7f768c06a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f7691e47640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f768c14aa00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7684009fb0 tx=0x7f76840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400e030 con 0x7f7678005190 2024-01-24T14:01:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684016470 con 0x7f7678005190 2024-01-24T14:01:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c1404e0 con 0x7f7678005190 2024-01-24T14:01:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684016820 con 0x7f7678005190 2024-01-24T14:01:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c144ea0 con 0x7f7678005190 2024-01-24T14:01:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f768c0b7c90 con 0x7f7678005190 2024-01-24T14:01:23.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.177+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7684016980 con 0x7f7678005190 2024-01-24T14:01:23.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7670065a60 0x7f7670067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f768400f070 con 0x7f7678005190 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f767006b8c0 0x7f767006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f767006e390 con 0x7f767006b8c0 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7684086310 con 0x7f7678005190 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f7691646640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7670065a60 0x7f7670067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f7692648640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f767006b8c0 0x7f767006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f7691646640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7670065a60 0x7f7670067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f767c001ec0 tx=0x7f767c000f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f7692648640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f767006b8c0 0x7f767006dce0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.181+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== osd.7 v2:172.21.15.124:6800/27691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f767006e390 con 0x7f767006b8c0 2024-01-24T14:01:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.193+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 --> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f768c0b79b0 con 0x7f767006b8c0 2024-01-24T14:01:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76827fc640 1 -- 172.21.15.27:0/1747983857 <== osd.7 v2:172.21.15.124:6800/27691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7688000f70 con 0x7f767006b8c0 2024-01-24T14:01:23.198 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-24T14:01:23.198 INFO:teuthology.orchestra.run.smithi027.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-24T14:01:23.198 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-24T14:01:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f767006b8c0 msgr2=0x7f767006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6800/27691,v1:172.21.15.124:6801/27691] conn(0x7f767006b8c0 0x7f767006dce0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7670065a60 msgr2=0x7f7670067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f7670065a60 0x7f7670067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f767c001ec0 tx=0x7f767c000f60 comp rx=0 tx=0).stop 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 msgr2=0x7f768c14aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 --2- 172.21.15.27:0/1747983857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7678005190 0x7f768c14aa00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7684009fb0 tx=0x7f76840115a0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f7692648640 1 -- 172.21.15.27:0/1747983857 reap_dead start 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 shutdown_connections 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 >> 172.21.15.27:0/1747983857 conn(0x7f768c0bcf70 msgr2=0x7f768c06ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 shutdown_connections 2024-01-24T14:01:23.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.197+0000 7f76940ab640 1 -- 172.21.15.27:0/1747983857 wait complete. 2024-01-24T14:01:23.213 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-24T14:01:23.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 Processor -- start 2024-01-24T14:01:23.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 -- start start 2024-01-24T14:01:23.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd540b9270 0x7efd54142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd54153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5406fed0 con 0x7efd540b6880 2024-01-24T14:01:23.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5414c400 con 0x7efd540b9270 2024-01-24T14:01:23.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5b790640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd540b8de0 con 0x7efd54142bc0 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd58d2b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efd540b9270 0x7efd54142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5952c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efd540b6880 0x7efd5414bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:59664/0 (socket says 172.21.15.27:59664) 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd5952c640 1 -- 172.21.15.27:0/1979251620 learned_addr learned my addr 172.21.15.27:0/1979251620 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd58d2b640 1 -- 172.21.15.27:0/1979251620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 msgr2=0x7efd54153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd59d2d640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd54153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd58d2b640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd54153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd58d2b640 1 -- 172.21.15.27:0/1979251620 >> v1:172.21.15.27:6789/0 conn(0x7efd540b6880 legacy=0x7efd5414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd4bfff640 1 -- 172.21.15.27:0/1979251620 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161523045 0 0) 0x7efd44001120 con 0x7efd540b6880 2024-01-24T14:01:23.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.321+0000 7efd58d2b640 1 -- 172.21.15.27:0/1979251620 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd540b8ae0 con 0x7efd540b9270 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd58d2b640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b9270 0x7efd54142680 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7efd500097c0 tx=0x7efd5001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f50978e2adad100 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd4bfff640 1 -- 172.21.15.27:0/1979251620 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500ab670 con 0x7efd540b9270 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd4bfff640 1 -- 172.21.15.27:0/1979251620 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500ab7d0 con 0x7efd540b9270 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd4bfff640 1 -- 172.21.15.27:0/1979251620 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500abb60 con 0x7efd540b9270 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/1979251620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b9270 msgr2=0x7efd54142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b9270 0x7efd54142680 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7efd500097c0 tx=0x7efd5001c450 comp rx=0 tx=0).stop 2024-01-24T14:01:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/1979251620 shutdown_connections 2024-01-24T14:01:23.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd54153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- 172.21.15.27:0/1979251620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b9270 0x7efd54142680 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/1979251620 >> 172.21.15.27:0/1979251620 conn(0x7efd5406ae30 msgr2=0x7efd5406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/1979251620 shutdown_connections 2024-01-24T14:01:23.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/1979251620 wait complete. 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 Processor -- start 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- start start 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd541e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd5413cb30 0x7efd541e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54148690 con 0x7efd540b6880 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54148910 con 0x7efd5413cb30 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd54148bf0 con 0x7efd54142bc0 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37466/0 (socket says 172.21.15.27:37466) 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 -- 172.21.15.27:0/3224467184 learned_addr learned my addr 172.21.15.27:0/3224467184 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 -- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 msgr2=0x7efd541e1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd58d2b640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd541e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd59d2d640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd5413cb30 0x7efd541e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd541e1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 -- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd5413cb30 msgr2=0x7efd541e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd5413cb30 0x7efd541e16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 -- 172.21.15.27:0/3224467184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009420 con 0x7efd540b6880 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5952c640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c480 tx=0x7efd4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440074e0 con 0x7efd540b6880 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44007660 con 0x7efd540b6880 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd54146a50 con 0x7efd540b6880 2024-01-24T14:01:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44004a30 con 0x7efd540b6880 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.325+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd541498c0 con 0x7efd540b6880 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5404e000 con 0x7efd540b6880 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd44004b90 con 0x7efd540b6880 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd49ffb640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 0x7efd38067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd44081dc0 con 0x7efd540b6880 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd58d2b640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 0x7efd38067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.329+0000 7efd58d2b640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 0x7efd38067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd500af000 tx=0x7efd50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.333+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7efd440535a0 con 0x7efd540b6880 2024-01-24T14:01:23.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7efd540b8010 con 0x7efd38065a90 2024-01-24T14:01:23.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd49ffb640 1 -- 172.21.15.27:0/3224467184 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd500bc090 con 0x7efd38065a90 2024-01-24T14:01:23.487 INFO:teuthology.orchestra.run.smithi027.stderr:instructed osd(s) 7 to deep-scrub 2024-01-24T14:01:23.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 msgr2=0x7efd38067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 0x7efd38067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd500af000 tx=0x7efd50008040 comp rx=0 tx=0).stop 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 msgr2=0x7efd54148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c480 tx=0x7efd4400c940 comp rx=0 tx=0).stop 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 shutdown_connections 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7efd38065a90 0x7efd38067f50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7efd5413cb30 0x7efd541e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7efd54142bc0 0x7efd541e1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 --2- 172.21.15.27:0/3224467184 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efd540b6880 0x7efd54148150 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 >> 172.21.15.27:0/3224467184 conn(0x7efd5406ae30 msgr2=0x7efd5414aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 shutdown_connections 2024-01-24T14:01:23.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.485+0000 7efd5b790640 1 -- 172.21.15.27:0/3224467184 wait complete. 2024-01-24T14:01:23.505 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T14:01:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.621+0000 7f02a54d5640 1 Processor -- start 2024-01-24T14:01:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 -- start start 2024-01-24T14:01:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f02a00b9900 0x7f02a00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a01429f0 0x7f02a0153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00b3c40 con 0x7f02a0071160 2024-01-24T14:01:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00b5140 con 0x7f02a00b9900 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f02a54d5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b9d50 con 0x7f02a01429f0 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f02a00b9900 0x7f02a00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f02a00b9900 0x7f02a00b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37470/0 (socket says 172.21.15.27:37470) 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 -- 172.21.15.27:0/3902543892 learned_addr learned my addr 172.21.15.27:0/3902543892 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029f7fe640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a01429f0 0x7f02a0153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 -- 172.21.15.27:0/3902543892 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a01429f0 msgr2=0x7f02a0153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a01429f0 0x7f02a0153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 -- 172.21.15.27:0/3902543892 >> v1:172.21.15.124:6789/0 conn(0x7f02a0071160 legacy=0x7f02a00b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 -- 172.21.15.27:0/3902543892 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00b9f60 con 0x7f02a00b9900 2024-01-24T14:01:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029e7fc640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a00b9900 0x7f02a00b42d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0294009870 tx=0x7f029401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e465f74c36ea4d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029dffb640 1 -- 172.21.15.27:0/3902543892 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a9620 con 0x7f02a00b9900 2024-01-24T14:01:23.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029dffb640 1 -- 172.21.15.27:0/3902543892 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02940a9780 con 0x7f02a00b9900 2024-01-24T14:01:23.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.625+0000 7f029dffb640 1 -- 172.21.15.27:0/3902543892 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a9b10 con 0x7f02a00b9900 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/3902543892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a00b9900 msgr2=0x7f02a00b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a00b9900 0x7f02a00b42d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0294009870 tx=0x7f029401c540 comp rx=0 tx=0).stop 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/3902543892 shutdown_connections 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a01429f0 0x7f02a0153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- 172.21.15.27:0/3902543892 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a00b9900 0x7f02a00b42d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/3902543892 >> 172.21.15.27:0/3902543892 conn(0x7f02a00be150 msgr2=0x7f02a00be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/3902543892 shutdown_connections 2024-01-24T14:01:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/3902543892 wait complete. 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 Processor -- start 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- start start 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 0x7f02a01e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02a01429f0 0x7f02a013f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0147380 con 0x7f02a0071160 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a01468a0 con 0x7f02a01429f0 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0146b80 con 0x7f02a00b9900 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37486/0 (socket says 172.21.15.27:37486) 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 -- 172.21.15.27:0/4021158117 learned_addr learned my addr 172.21.15.27:0/4021158117 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029e7fc640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 0x7f02a01e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 -- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 msgr2=0x7f02a01e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029f7fe640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02a01429f0 0x7f02a013f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 0x7f02a01e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 -- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02a01429f0 msgr2=0x7f02a013f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02a01429f0 0x7f02a013f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 -- 172.21.15.27:0/4021158117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940094d0 con 0x7f02a0071160 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029e7fc640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 0x7f02a01e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f029effd640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f029000c500 tx=0x7f029000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290005220 con 0x7f02a0071160 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290005380 con 0x7f02a0071160 2024-01-24T14:01:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0146e60 con 0x7f02a0071160 2024-01-24T14:01:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290007270 con 0x7f02a0071160 2024-01-24T14:01:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.629+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00b81b0 con 0x7f02a0071160 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a0146700 con 0x7f02a0071160 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02900073d0 con 0x7f02a0071160 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f02877fe640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 0x7f028c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0290082750 con 0x7f02a0071160 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f029e7fc640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 0x7f028c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.633+0000 7f029e7fc640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 0x7f028c067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02940ae000 tx=0x7f02940b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:23.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.637+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f02a0146700 con 0x7f02a0071160 2024-01-24T14:01:23.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.805+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02a00b7160 con 0x7f028c065a60 2024-01-24T14:01:23.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02877fe640 1 -- 172.21.15.27:0/4021158117 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49433 (secure 0 0 0) 0x7f02a00b7160 con 0x7f028c065a60 2024-01-24T14:01:23.815 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:23.815 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T14:01:23.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 msgr2=0x7f028c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 0x7f028c067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02940ae000 tx=0x7f02940b3040 comp rx=0 tx=0).stop 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 msgr2=0x7f02a0148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f029000c500 tx=0x7f029000c9c0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 shutdown_connections 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f028c065a60 0x7f028c067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f02a01429f0 0x7f02a013f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f02a00b9900 0x7f02a01e0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 --2- 172.21.15.27:0/4021158117 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f02a0071160 0x7f02a0148c80 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:23.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 >> 172.21.15.27:0/4021158117 conn(0x7f02a00be150 msgr2=0x7f02a00a2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:23.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 shutdown_connections 2024-01-24T14:01:23.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:23.813+0000 7f02a54d5640 1 -- 172.21.15.27:0/4021158117 wait complete. 2024-01-24T14:01:23.832 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":2348,"stamp":"2024-01-24T14:01:23.249105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9707916,"kb_used_data":4232,"kb_used_omap":13,"kb_used_meta":9703602,"kb_avail":745266804,"statfs":{"total":773094113280,"available":763153207296,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9936488536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1037,"apply_latency_ms":1037,"commit_latency_ns":1037000000,"apply_latency_ns":1037000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-529797120,"num_objects":-1350,"num_object_clones":0,"num_object_copies":-2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1350,"num_whiteouts":0,"num_read":-54299,"num_read_kb":-53388304,"num_write":-1425948,"num_write_kb":-58836472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002225"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-24T14:01:12.620214+0000","last_change":"2024-01-24T12:44:01.146822+0000","last_active":"2024-01-24T14:01:12.620214+0000","last_peered":"2024-01-24T14:01:12.620214+0000","last_clean":"2024-01-24T14:01:12.620214+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T14:01:12.620214+0000","last_undegraded":"2024-01-24T14:01:12.620214+0000","last_fullsized":"2024-01-24T14:01:12.620214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-24T12:43:59.829947+0000","last_clean_scrub_stamp":"2024-01-24T12:43:59.829947+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T19:37:14.417761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575779,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227660,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1226686,"kb_avail":93144180,"statfs":{"total":96636764160,"available":95379640320,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1256126731},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2270000000000001,"5min":1.4410000000000001,"15min":8.1880000000000006},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.88100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.141,"5min":1.3240000000000001,"15min":8.1460000000000008},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.84199999999999997,"15min":0.99099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":3.327,"5min":3.327,"15min":24.010000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.82899999999999996,"15min":0.88600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.302,"15min":4.4950000000000001},"last":0.438}]},{"osd":2,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46600000000000003},"max":{"1min":1.0740000000000001,"5min":1.2410000000000001,"15min":7.202},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88500000000000001,"15min":0.93000000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":3.879},"last":0.34799999999999998}]},{"osd":3,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.98999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1739999999999999,"5min":1.3220000000000001,"15min":14.164999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.97599999999999998,"15min":1.0389999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.23,"5min":1.3009999999999999,"15min":13.304},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.93799999999999994},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.5900000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0029999999999999,"15min":0.98699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42699999999999999},"max":{"1min":1.294,"5min":1.3999999999999999,"15min":1.677},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0840000000000001,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.486,"5min":1.524,"15min":9.6890000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1060000000000001,"15min":1.1120000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.321,"5min":1.5009999999999999,"15min":9.5440000000000005},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:00:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.1359999999999999,"15min":1.1160000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.359,"5min":1.502,"15min":1.7050000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.151,"15min":1.109},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7569999999999997,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":0.502}]}]},{"osd":6,"up_from":13,"seq":55834575780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":916360,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":915966,"kb_avail":93455480,"statfs":{"total":96636764160,"available":95698411520,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":937949451},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":487,"apply_latency_ms":487,"commit_latency_ns":487000000,"apply_latency_ns":487000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.85399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":1.883,"5min":1.883,"15min":10.903},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0979999999999999,"5min":4.7750000000000004,"15min":6.8630000000000004},"last":0.69799999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.97399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.054,"5min":5.0369999999999999,"15min":29.503},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84699999999999998,"15min":0.98399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":3.9430000000000001,"15min":25.587},"last":1.097}]},{"osd":2,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":1.161},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":82.552000000000007},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94499999999999995,"15min":0.98999999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33900000000000002},"max":{"1min":1.163,"5min":4.9100000000000001,"15min":9.0719999999999992},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":1.1699999999999999,"5min":4.8520000000000003,"15min":13.555999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.90100000000000002,"15min":1.042},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":5.0609999999999999,"15min":13.352},"last":0.93999999999999995}]},{"osd":4,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.0369999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":13.413},"last":1.175},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.069,"15min":1.2090000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":1.3660000000000001,"5min":4.8810000000000002,"15min":39.143999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.0349999999999999,"15min":1.0529999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3879999999999999,"5min":4.9829999999999997,"15min":13.305},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.1060000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":11.635999999999999},"last":1.2290000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":1.4370000000000001,"5min":4.8209999999999997,"15min":7.1779999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.877,"5min":1.0760000000000001,"15min":1.133},"min":{"1min":0.438,"5min":0.438,"15min":0.39700000000000002},"max":{"1min":1.27,"5min":5.0119999999999996,"15min":13.388},"last":1.258}]}]},{"osd":5,"up_from":13,"seq":55834575781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1303432,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1303038,"kb_avail":93068408,"statfs":{"total":96636764160,"available":95302049792,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1334311179},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.218},"max":{"1min":1.302,"5min":1.302,"15min":3.0760000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":0.86299999999999999,"15min":0.83699999999999997},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":5.7629999999999999,"5min":5.7629999999999999,"15min":5.7629999999999999},"last":0.91600000000000004}]},{"osd":1,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.81499999999999995,"15min":0.83499999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":6.8849999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.212,"5min":0.92700000000000005,"15min":0.93200000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.82399999999999995}]},{"osd":2,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.96699999999999997,"15min":0.91600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32200000000000001},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.88600000000000001}]},{"osd":3,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.91400000000000003,"15min":0.94199999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.508,"5min":1.508,"15min":3.169},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.254,"5min":1.0529999999999999,"15min":1.01},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.69699999999999995}]},{"osd":4,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.008,"15min":0.96599999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0449999999999999,"15min":1.0740000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.611,"5min":1.611,"15min":9.9760000000000009},"last":1.147}]},{"osd":6,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.099,"15min":1.056},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.7469999999999999,"5min":3.7469999999999999,"15min":3.7469999999999999},"last":1.099},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1220000000000001,"15min":1.085},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.95099999999999996}]},{"osd":7,"last update":"Wed Jan 24 14:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.115,"15min":1.139},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.5389999999999999,"5min":1.5900000000000001,"15min":7.0700000000000003},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2010000000000001,"15min":1.1719999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":1.181}]}]},{"osd":4,"up_from":13,"seq":55834575779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1562504,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1562110,"kb_avail":92809336,"statfs":{"total":96636764160,"available":95036760064,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1599600907},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80600000000000005,"15min":0.86299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":10.195},"last":0.755},{"interface":"front","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.88400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":5.2400000000000002},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80900000000000005,"15min":0.87},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.2849999999999999,"15min":10.234999999999999},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.85399999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.35399999999999998},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.92200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":1.248,"5min":1.248,"15min":10.255000000000001},"last":1.0369999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":0.91000000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.258,"5min":1.258,"15min":6.0579999999999998},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93300000000000005,"15min":0.97799999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":5.9020000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.27100000000000002},"max":{"1min":6.4649999999999999,"5min":6.4649999999999999,"15min":10.4},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.94699999999999995,"15min":0.97799999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.488,"5min":1.488,"15min":5.3630000000000004},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1,"15min":1.0049999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.048,"5min":1.071,"15min":1.0980000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":10.462},"last":1.115}]},{"osd":7,"last update":"Wed Jan 24 14:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.0720000000000001,"15min":1.0649999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.5759999999999996,"5min":6.5759999999999996,"15min":6.5759999999999996},"last":1.081},{"interface":"front","average":{"1min":1,"5min":1.0860000000000001,"15min":1.101},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.33100000000000002},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.0669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1303752,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1303358,"kb_avail":93068088,"statfs":{"total":96636764160,"available":95301722112,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1334638859},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":207,"apply_latency_ms":207,"commit_latency_ns":207000000,"apply_latency_ns":207000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58899999999999997,"15min":0.64800000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.191},"max":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":2.9860000000000002},"last":0.627},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.63400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.22500000000000001},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.276},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.3620000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68500000000000005,"15min":0.77600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.22700000000000001},"max":{"1min":1.04,"5min":1.3320000000000001,"15min":11.891},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.79400000000000004},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0640000000000001,"5min":1.3859999999999999,"15min":4.8230000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.86799999999999999},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":1.2689999999999999,"15min":4.9349999999999996},"last":0.79500000000000004}]},{"osd":4,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.999,"15min":1},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":3.4529999999999998,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":0.98899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":1.482,"5min":1.585,"15min":1.6080000000000001},"last":1.046}]},{"osd":5,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.98899999999999999,"15min":1.2789999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4650000000000001,"5min":1.714,"15min":57.396999999999998},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.02,"15min":1.1299999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42099999999999999},"max":{"1min":1.1879999999999999,"5min":2.54,"15min":25.677},"last":1.2390000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.018,"15min":1.137},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.7809999999999999,"15min":21.785},"last":1.206},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"max":{"1min":1.5229999999999999,"5min":1.804,"15min":2.7949999999999999},"last":0.96799999999999997}]},{"osd":7,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.042,"15min":1.1539999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.25,"5min":1.5509999999999999,"15min":12.884},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.1479999999999999},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.397,"5min":1.665,"15min":5.3209999999999997},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1010956,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1010558,"kb_avail":93360884,"statfs":{"total":96636764160,"available":95601545216,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1034811659},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64300000000000002,"15min":0.83399999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.018,"5min":1.696,"15min":39.767000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.66800000000000004,"15min":0.76000000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.223},"max":{"1min":2.516,"5min":2.516,"15min":11.352},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67500000000000004,"15min":0.755},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":1.2689999999999999,"5min":1.3240000000000001,"15min":2.3140000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.755,"15min":0.86099999999999999},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":13.101000000000001},"last":0.504}]},{"osd":3,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.79600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.26000000000000001},"max":{"1min":1.0149999999999999,"5min":1.7370000000000001,"15min":7.1710000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82299999999999995,"15min":0.90900000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":1.069,"5min":1.887,"15min":6.891},"last":0.65400000000000003}]},{"osd":4,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.681,"5min":3.681,"15min":5.0899999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":0.96499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.313},"max":{"1min":1.3149999999999999,"5min":1.5249999999999999,"15min":4.5869999999999997},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.054,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.35899999999999999},"max":{"1min":1.2609999999999999,"5min":1.5620000000000001,"15min":8.4190000000000005},"last":0.88},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.091,"15min":1.1319999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.7549999999999999,"5min":3.7549999999999999,"15min":4.577},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98199999999999998,"15min":1.0640000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.39400000000000002},"max":{"1min":1.534,"5min":1.792,"15min":5.859},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0700000000000001,"15min":1.179},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45700000000000002},"max":{"1min":1.667,"5min":1.667,"15min":13.824},"last":0.72399999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:00:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.147,"15min":1.1639999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":5.4470000000000001,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.002,"15min":1.099},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.36699999999999999},"max":{"1min":1.619,"5min":1.619,"15min":4.6580000000000004},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834575779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1494088,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1493694,"kb_avail":92877752,"statfs":{"total":96636764160,"available":95106818048,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1529542923},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":343,"apply_latency_ms":343,"commit_latency_ns":343000000,"apply_latency_ns":343000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63800000000000001,"15min":0.749},"min":{"1min":0.223,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":25.135999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.64000000000000001,"15min":0.754},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.601,"5min":2.601,"15min":25.262},"last":0.48599999999999999}]},{"osd":2,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63600000000000001,"15min":0.67800000000000005},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.3,"5min":1.478,"15min":3.6139999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.679,"5min":1.679,"15min":4.8259999999999996},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.78700000000000003,"15min":0.84099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.931,"5min":1.931,"15min":5.4850000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.95899999999999996,"15min":0.98899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.28399999999999997},"max":{"1min":1.4450000000000001,"5min":1.7769999999999999,"15min":7.9800000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0129999999999999,"15min":1.073},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":4.8710000000000004},"last":1.008}]},{"osd":5,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":4.3810000000000002,"5min":1.7130000000000001,"15min":1.337},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.41399999999999998},"max":{"1min":74.188000000000002,"5min":74.188000000000002,"15min":74.188000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.71,"15min":1.3260000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":74.143000000000001,"5min":74.143000000000001,"15min":74.143000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.1759999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.373},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":16.021999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0600000000000001,"15min":1.125},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39000000000000001},"max":{"1min":1.522,"5min":1.804,"15min":7.6950000000000003},"last":0.91500000000000004}]},{"osd":7,"last update":"Wed Jan 24 14:00:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.141,"15min":1.1779999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":5.8600000000000003},"last":1.089},{"interface":"front","average":{"1min":1.127,"5min":1.1200000000000001,"15min":1.234},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44700000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":16.082000000000001},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575781,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889164,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":888190,"kb_avail":93482676,"statfs":{"total":96636764160,"available":95726260224,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":909506827},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.65200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2869999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.032,"5min":1.26,"15min":1.3899999999999999},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.72099999999999997},"min":{"1min":0.35099999999999998,"5min":0.27100000000000002,"15min":0.222},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.585},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63600000000000001,"15min":0.72999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98099999999999998,"5min":1.083,"15min":6.399},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":18.024999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.86799999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.173,"5min":1.194,"15min":1.5289999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.94899999999999995,"15min":1.0149999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.454,"5min":1.5489999999999999,"15min":6.3499999999999996},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2869999999999999,"5min":1.3700000000000001,"15min":1.593},"last":1.0049999999999999}]},{"osd":5,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89900000000000002,"15min":0.94799999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.46,"5min":1.46,"15min":1.587},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.9930000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.143},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.371},"max":{"1min":1.651,"5min":1.651,"15min":2.101},"last":1.081},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0409999999999999,"15min":1.1220000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.45,"15min":6.3109999999999999},"last":1.1140000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:00:30 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0249999999999999,"15min":1.113},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.415,"5min":1.6140000000000001,"15min":6.3760000000000003},"last":1.042},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.97299999999999998,"15min":1.0529999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3700000000000001,"5min":1.4990000000000001,"15min":1.6699999999999999},"last":0.91600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T14:01:23.835 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-24T12:43:59.829947+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=24, tm_hour=12, tm_min=43, tm_sec=59, tm_wday=2, tm_yday=24, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=24, tm_hour=14, tm_min=1, tm_sec=18, tm_wday=2, tm_yday=24, tm_isdst=0) 2024-01-24T14:01:23.836 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-24T14:01:43.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-24T14:01:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 Processor -- start 2024-01-24T14:01:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 -- start start 2024-01-24T14:01:43.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f04c4069d20 0x7f04c406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c40b81c0 0x7f04c40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04c414a9e0 0x7f04c414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40702c0 con 0x7f04c414a9e0 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40b8650 con 0x7f04c4069d20 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04cb2a2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c406ff50 con 0x7f04c40b81c0 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04c414a9e0 0x7f04c414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04c414a9e0 0x7f04c414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48618/0 (socket says 172.21.15.27:48618) 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 -- 172.21.15.27:0/2471439620 learned_addr learned my addr 172.21.15.27:0/2471439620 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:43.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c883d640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c40b81c0 0x7f04c40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 -- 172.21.15.27:0/2471439620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c40b81c0 msgr2=0x7f04c40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:43.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c40b81c0 0x7f04c40b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 -- 172.21.15.27:0/2471439620 >> v2:172.21.15.124:3300/0 conn(0x7f04c4069d20 msgr2=0x7f04c406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:43.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 --2- 172.21.15.27:0/2471439620 >> v2:172.21.15.124:3300/0 conn(0x7f04c4069d20 0x7f04c406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.949+0000 7f04c983f640 1 -- 172.21.15.27:0/2471439620 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4145050 con 0x7f04c414a9e0 2024-01-24T14:01:43.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c983f640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c414a9e0 0x7f04c414dfb0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f04c40baaf0 tx=0x7f04bc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd51e392e1237500 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:43.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04bbfff640 1 -- 172.21.15.27:0/2471439620 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0af400 con 0x7f04c414a9e0 2024-01-24T14:01:43.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04bbfff640 1 -- 172.21.15.27:0/2471439620 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc0ab050 con 0x7f04c414a9e0 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04bbfff640 1 -- 172.21.15.27:0/2471439620 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0af780 con 0x7f04c414a9e0 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- 172.21.15.27:0/2471439620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c414a9e0 msgr2=0x7f04c414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c414a9e0 0x7f04c414dfb0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f04c40baaf0 tx=0x7f04bc01f1c0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- 172.21.15.27:0/2471439620 shutdown_connections 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c414a9e0 0x7f04c414dfb0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/2471439620 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c40b81c0 0x7f04c40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/2471439620 >> v2:172.21.15.124:3300/0 conn(0x7f04c4069d20 0x7f04c406a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- 172.21.15.27:0/2471439620 >> 172.21.15.27:0/2471439620 conn(0x7f04c406ae30 msgr2=0x7f04c406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:43.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- 172.21.15.27:0/2471439620 shutdown_connections 2024-01-24T14:01:43.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- 172.21.15.27:0/2471439620 wait complete. 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 Processor -- start 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- start start 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 0x7f04c41d5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 0x7f04c41d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41d5ed0 con 0x7f04c40b4310 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4148fb0 con 0x7f04c414a9e0 2024-01-24T14:01:43.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04cb2a2640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41d7660 con 0x7f04c4069d20 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c983f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c983f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48632/0 (socket says 172.21.15.27:48632) 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c983f640 1 -- 172.21.15.27:0/94514928 learned_addr learned my addr 172.21.15.27:0/94514928 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c883d640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 0x7f04c41d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.953+0000 7f04c903e640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 0x7f04c41d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 -- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 msgr2=0x7f04c41d5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:43.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 0x7f04c41d5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 -- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 msgr2=0x7f04c41d6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 0x7f04c41d6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 -- 172.21.15.27:0/94514928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009b30 con 0x7f04c40b4310 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c903e640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 0x7f04c41d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c883d640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 0x7f04c41d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c983f640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0b2040 tx=0x7f04bc01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0afd60 con 0x7f04c40b4310 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc009510 con 0x7f04c40b4310 2024-01-24T14:01:43.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0ba660 con 0x7f04c40b4310 2024-01-24T14:01:43.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c41d6b70 con 0x7f04c40b4310 2024-01-24T14:01:43.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4148960 con 0x7f04c40b4310 2024-01-24T14:01:43.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4149160 con 0x7f04c40b4310 2024-01-24T14:01:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04bc0b6040 con 0x7f04c40b4310 2024-01-24T14:01:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 0x7f04a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04bc1211b0 con 0x7f04c40b4310 2024-01-24T14:01:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c903e640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 0x7f04a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.957+0000 7f04c903e640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 0x7f04a8067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04c000a8b0 tx=0x7f04c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:43.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:43.961+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f04c4149160 con 0x7f04c40b4310 2024-01-24T14:01:44.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.113+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 --> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04c40b8c30 con 0x7f04a8065a60 2024-01-24T14:01:44.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.117+0000 7f04b9ffb640 1 -- 172.21.15.27:0/94514928 <== mgr.4100 v2:172.21.15.124:6832/27368 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49356 (secure 0 0 0) 0x7f04c000c7d0 con 0x7f04a8065a60 2024-01-24T14:01:44.121 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:44.122 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 msgr2=0x7f04a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 0x7f04a8067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04c000a8b0 tx=0x7f04c0008040 comp rx=0 tx=0).stop 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 msgr2=0x7f04c4149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0b2040 tx=0x7f04bc01bf60 comp rx=0 tx=0).stop 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 shutdown_connections 2024-01-24T14:01:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f04a8065a60 0x7f04a8067f20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04c40b4310 0x7f04c4149440 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f04c414a9e0 0x7f04c41d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 --2- 172.21.15.27:0/94514928 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f04c4069d20 0x7f04c41d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 >> 172.21.15.27:0/94514928 conn(0x7f04c406ae30 msgr2=0x7f04c4141520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 shutdown_connections 2024-01-24T14:01:44.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.121+0000 7f04cb2a2640 1 -- 172.21.15.27:0/94514928 wait complete. 2024-01-24T14:01:44.138 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":2358,"stamp":"2024-01-24T14:01:43.254175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9707916,"kb_used_data":4232,"kb_used_omap":13,"kb_used_meta":9703602,"kb_avail":745266804,"statfs":{"total":773094113280,"available":763153207296,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9936488536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003092"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-24T14:01:26.787864+0000","last_change":"2024-01-24T14:01:26.788096+0000","last_active":"2024-01-24T14:01:26.787864+0000","last_peered":"2024-01-24T14:01:26.787864+0000","last_clean":"2024-01-24T14:01:26.787864+0000","last_became_active":"2024-01-24T12:44:01.144526+0000","last_became_peered":"2024-01-24T12:44:01.144526+0000","last_unstale":"2024-01-24T14:01:26.787864+0000","last_undegraded":"2024-01-24T14:01:26.787864+0000","last_fullsized":"2024-01-24T14:01:26.787864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-01-24T14:01:26.787818+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-01-24T14:01:26.787818+0000","last_clean_scrub_stamp":"2024-01-24T14:01:26.787818+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-25T22:57:14.036800+0000","scrub_duration":0.49420556700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575783,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227660,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1226686,"kb_avail":93144180,"statfs":{"total":96636764160,"available":95379640320,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1256126731},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":0.96199999999999997,"15min":0.876},"min":{"1min":0.28399999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":14.23,"5min":14.23,"15min":14.23},"last":1.097},{"interface":"front","average":{"1min":1.637,"5min":0.98699999999999999,"15min":0.92300000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":14.605,"5min":14.605,"15min":14.605},"last":1.141}]},{"osd":1,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.413,"5min":14.413,"15min":24.010000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.5580000000000001,"5min":0.97199999999999998,"15min":0.92600000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":14.782999999999999,"5min":14.782999999999999,"15min":14.782999999999999},"last":1.24}]},{"osd":2,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.85699999999999998,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.5230000000000001,"5min":2.5230000000000001,"15min":7.202},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.0189999999999999,"15min":0.96699999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":14.52,"5min":14.52,"15min":14.52},"last":0.77900000000000003}]},{"osd":3,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.875,"15min":0.97899999999999998},"min":{"1min":0.42099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":14.164999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.0940000000000001,"15min":1.0740000000000001},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":14.590999999999999,"5min":14.590999999999999,"15min":14.590999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.093,"15min":0.98699999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":14.259,"5min":14.259,"15min":14.259},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.0620000000000001}]},{"osd":5,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.194,"15min":1.131},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":14.692,"5min":14.692,"15min":14.692},"last":0.997},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.236,"15min":1.159},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":14.31,"5min":14.31,"15min":14.31},"last":1.3819999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:01:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.24,"15min":1.1559999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":14.343999999999999,"5min":14.343999999999999,"15min":14.343999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.1220000000000001,"15min":1.101},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.8170000000000002,"5min":4.7569999999999997,"15min":4.7569999999999997},"last":1.1859999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":916360,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":915966,"kb_avail":93455480,"statfs":{"total":96636764160,"available":95698411520,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":937949451},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.85399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":1.883,"5min":1.883,"15min":10.903},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.872},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.0979999999999999,"5min":4.7750000000000004,"15min":6.8630000000000004},"last":1.052}]},{"osd":1,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.97399999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.054,"5min":5.0369999999999999,"15min":29.503},"last":1.01},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84699999999999998,"15min":0.98399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":3.9430000000000001,"15min":25.587},"last":0.97699999999999998}]},{"osd":2,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":1.161},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":82.552000000000007},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.94499999999999995,"15min":0.98999999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33900000000000002},"max":{"1min":1.163,"5min":4.9100000000000001,"15min":9.0719999999999992},"last":0.90400000000000003}]},{"osd":3,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":1.1699999999999999,"5min":4.8520000000000003,"15min":13.555999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.90100000000000002,"15min":1.042},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":5.0609999999999999,"15min":13.352},"last":0.68400000000000005}]},{"osd":4,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94799999999999995,"15min":1.0369999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":13.413},"last":1.093},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.069,"15min":1.2090000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":1.3660000000000001,"5min":4.8810000000000002,"15min":39.143999999999998},"last":1.1459999999999999}]},{"osd":5,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":1.0349999999999999,"15min":1.0529999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3879999999999999,"5min":4.9829999999999997,"15min":13.305},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0620000000000001,"15min":1.1060000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":11.635999999999999},"last":1.196}]},{"osd":7,"last update":"Wed Jan 24 14:01:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.1339999999999999,"15min":1.1419999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":1.4370000000000001,"5min":4.8209999999999997,"15min":7.1779999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.877,"5min":1.0760000000000001,"15min":1.133},"min":{"1min":0.438,"5min":0.438,"15min":0.39700000000000002},"max":{"1min":1.27,"5min":5.0119999999999996,"15min":13.388},"last":1.1739999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1303432,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1303038,"kb_avail":93068408,"statfs":{"total":96636764160,"available":95302049792,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1334311179},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.25800000000000001,"5min":0.246,"15min":0.218},"max":{"1min":1.097,"5min":1.302,"15min":3.0760000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.86599999999999999,"15min":0.82299999999999995},"min":{"1min":0.372,"5min":0.251,"15min":0.251},"max":{"1min":1.1930000000000001,"5min":5.7629999999999999,"15min":5.7629999999999999},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.877,"15min":0.84399999999999997},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":8.6240000000000006,"5min":8.6240000000000006,"15min":8.6240000000000006},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.35299999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.143,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.88500000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.94799999999999995,"15min":0.90500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1899999999999999,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.96499999999999997,"15min":0.92900000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.6419999999999999,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":1.1359999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.89300000000000002,"15min":0.92900000000000005},"min":{"1min":0.40999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.2909999999999999,"5min":1.508,"15min":3.169},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":1.03,"15min":0.995},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.276,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0029999999999999,"15min":0.96499999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.6070000000000002,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":1.077},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0329999999999999,"15min":1.069},"min":{"1min":0.51000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":9.9760000000000009},"last":1.02}]},{"osd":6,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.113,"15min":1.0669999999999999},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":5.3310000000000004,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.123,"15min":1.087},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":5.3819999999999997,"5min":5.3819999999999997,"15min":5.3819999999999997},"last":1.1890000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.081,"15min":1.125},"min":{"1min":0.45000000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2310000000000001,"5min":1.5900000000000001,"15min":7.0700000000000003},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.173,"15min":1.159},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.4630000000000001,"5min":3.657,"15min":3.657},"last":1.1599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1562504,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1562110,"kb_avail":92809336,"statfs":{"total":96636764160,"available":95036760064,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1599600907},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80900000000000005,"15min":0.85199999999999998},"min":{"1min":0.44400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1399999999999999,"5min":1.2330000000000001,"15min":10.195},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1080000000000001,"5min":1.3420000000000001,"15min":5.2400000000000002},"last":1.0029999999999999}]},{"osd":1,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.48099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.85499999999999998,"15min":0.879},"min":{"1min":0.37,"5min":0.37,"15min":0.30199999999999999},"max":{"1min":5.444,"5min":5.444,"15min":10.234999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":0.90700000000000003,"15min":0.875},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.35399999999999998},"max":{"1min":5.508,"5min":5.508,"15min":5.508},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34000000000000002},"max":{"1min":2.8180000000000001,"5min":2.8180000000000001,"15min":10.255000000000001},"last":1.194}]},{"osd":3,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.88600000000000001},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0249999999999999,"5min":1.258,"15min":6.0579999999999998},"last":0.754},{"interface":"front","average":{"1min":1.1279999999999999,"5min":0.97599999999999998,"15min":0.98599999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.423,"5min":5.423,"15min":5.9020000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.997},"min":{"1min":0.318,"5min":0.318,"15min":0.27100000000000002},"max":{"1min":1.1919999999999999,"5min":6.4649999999999999,"15min":10.4},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.077,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.45400000000000001,"5min":0.309,"15min":0.309},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":5.3630000000000004},"last":1.0720000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.52800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.294,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.0960000000000001},"min":{"1min":0.42499999999999999,"5min":0.376,"15min":0.32200000000000001},"max":{"1min":1.226,"5min":3.9420000000000002,"15min":10.462},"last":0.83599999999999997}]},{"osd":7,"last update":"Wed Jan 24 14:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.069,"15min":1.0649999999999999},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.274,"5min":6.5759999999999996,"15min":6.5759999999999996},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.109,"15min":1.1140000000000001},"min":{"1min":0.66000000000000003,"5min":0.44600000000000001,"15min":0.33100000000000002},"max":{"1min":3.3010000000000002,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.103}]}]},{"osd":3,"up_from":13,"seq":55834575784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1303752,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1303358,"kb_avail":93068088,"statfs":{"total":96636764160,"available":95301722112,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1334638859},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58899999999999997,"15min":0.64800000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.191},"max":{"1min":0.84399999999999997,"5min":0.92400000000000004,"15min":2.9860000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.63400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.22500000000000001},"max":{"1min":0.92700000000000005,"5min":1.147,"15min":1.276},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63100000000000001,"15min":0.67100000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.22500000000000001},"max":{"1min":0.94699999999999995,"5min":1.131,"15min":1.3620000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68500000000000005,"15min":0.77600000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.22700000000000001},"max":{"1min":1.04,"5min":1.3320000000000001,"15min":11.891},"last":0.747}]},{"osd":2,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.79400000000000004},"min":{"1min":0.36399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0640000000000001,"5min":1.3859999999999999,"15min":4.8230000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":0.86799999999999999},"min":{"1min":0.35099999999999998,"5min":0.33800000000000002,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":1.2689999999999999,"15min":4.9349999999999996},"last":0.90400000000000003}]},{"osd":4,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.999,"15min":1},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":3.4529999999999998,"5min":4.0350000000000001,"15min":4.0350000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.94299999999999995,"15min":0.98899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.29599999999999999},"max":{"1min":1.482,"5min":1.585,"15min":1.6080000000000001},"last":0.96599999999999997}]},{"osd":5,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.98899999999999999,"15min":1.2789999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4650000000000001,"5min":1.714,"15min":57.396999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":1.02,"15min":1.1299999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42099999999999999},"max":{"1min":1.1879999999999999,"5min":2.54,"15min":25.677},"last":0.95199999999999996}]},{"osd":6,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.018,"15min":1.137},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.7809999999999999,"15min":21.785},"last":1.004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"max":{"1min":1.5229999999999999,"5min":1.804,"15min":2.7949999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Wed Jan 24 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.042,"15min":1.1539999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.25,"5min":1.5509999999999999,"15min":12.884},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.1479999999999999},"min":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.397,"5min":1.665,"15min":5.3209999999999997},"last":1.05}]}]},{"osd":2,"up_from":13,"seq":55834575782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1010956,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1010558,"kb_avail":93360884,"statfs":{"total":96636764160,"available":95601545216,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1034811659},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66500000000000004,"15min":0.82399999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":39.767000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68700000000000006,"15min":0.753},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.223},"max":{"1min":4.5389999999999997,"5min":4.5389999999999997,"15min":11.352},"last":0.81699999999999995}]},{"osd":1,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68899999999999995,"15min":0.74199999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.219},"max":{"1min":3.4969999999999999,"5min":3.4969999999999999,"15min":3.4969999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.85699999999999998},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.28499999999999998},"max":{"1min":4.617,"5min":4.617,"15min":13.101000000000001},"last":1.0649999999999999}]},{"osd":3,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.77600000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26000000000000001},"max":{"1min":1.0409999999999999,"5min":1.7370000000000001,"15min":7.1710000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82799999999999996,"15min":0.89400000000000002},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":3.4729999999999999,"5min":3.4729999999999999,"15min":6.891},"last":1.095}]},{"osd":4,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0089999999999999,"15min":1.054},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.8040000000000003,"5min":4.8040000000000003,"15min":5.0899999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88100000000000001,"15min":0.95099999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2769999999999999,"5min":1.5249999999999999,"15min":4.5869999999999997},"last":0.95099999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.085,"15min":1.1279999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":9.2469999999999999,"5min":9.2469999999999999,"15min":9.2469999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.157,"15min":1.1459999999999999},"min":{"1min":0.433,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.1809999999999992,"5min":9.1809999999999992,"15min":9.1809999999999992},"last":1.4319999999999999}]},{"osd":6,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.046},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.39400000000000002},"max":{"1min":1.4870000000000001,"5min":1.792,"15min":5.859},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.1599999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":13.824},"last":1.3049999999999999}]},{"osd":7,"last update":"Wed Jan 24 14:01:27 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.155,"15min":1.157},"min":{"1min":0.49199999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":4.8570000000000002,"5min":5.4470000000000001,"15min":5.4470000000000001},"last":1.351},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0129999999999999,"15min":1.0820000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.36699999999999999},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.6580000000000004},"last":1.2749999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1494088,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1493694,"kb_avail":92877752,"statfs":{"total":96636764160,"available":95106818048,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1529542923},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2440000000000002,"5min":0.96899999999999997,"15min":0.84799999999999998},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.20100000000000001},"max":{"1min":31.59,"5min":31.59,"15min":31.59},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.3759999999999999,"5min":0.81299999999999994,"15min":0.79300000000000004},"min":{"1min":0.27600000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":11.801,"5min":11.801,"15min":25.262},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.36199999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.899,"5min":4.899,"15min":4.899},"last":0.78800000000000003},{"interface":"front","average":{"1min":2.1219999999999999,"5min":1.044,"15min":0.85199999999999998},"min":{"1min":0.33700000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":31.805,"5min":31.805,"15min":31.805},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":2.1429999999999998,"5min":1.0669999999999999,"15min":0.91700000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":31.765999999999998,"5min":31.765999999999998,"15min":31.765999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":2.1680000000000001,"5min":1.0980000000000001,"15min":0.90200000000000002},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":31.879999999999999,"5min":31.879999999999999,"15min":31.879999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.97299999999999998,"15min":0.98399999999999999},"min":{"1min":0.44900000000000001,"5min":0.36399999999999999,"15min":0.28399999999999997},"max":{"1min":4.5949999999999998,"5min":4.5949999999999998,"15min":7.9800000000000004},"last":0.872},{"interface":"front","average":{"1min":2.3879999999999999,"5min":1.2929999999999999,"15min":1.1479999999999999},"min":{"1min":0.53800000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":31.734000000000002,"5min":31.734000000000002,"15min":31.734000000000002},"last":1.111}]},{"osd":5,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.7909999999999999,"15min":1.355},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.7279999999999998,"5min":74.188000000000002,"15min":74.188000000000002},"last":1.081},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.891,"15min":1.373},"min":{"1min":0.49099999999999999,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":22.780999999999999,"5min":74.143000000000001,"15min":74.143000000000001},"last":0.92100000000000004}]},{"osd":6,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.1559999999999999,"15min":1.181},"min":{"1min":0.44,"5min":0.44,"15min":0.373},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":16.021999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.081,"15min":1.1140000000000001},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.39000000000000001},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":7.6950000000000003},"last":0.95799999999999996}]},{"osd":7,"last update":"Wed Jan 24 14:01:33 2024","interfaces":[{"interface":"back","average":{"1min":2.5390000000000001,"5min":1.4379999999999999,"15min":1.2569999999999999},"min":{"1min":0.54700000000000004,"5min":0.438,"15min":0.438},"max":{"1min":31.699000000000002,"5min":31.699000000000002,"15min":31.699000000000002},"last":1.052},{"interface":"front","average":{"1min":1.454,"5min":1.206,"15min":1.2430000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.44700000000000001},"max":{"1min":5.7990000000000004,"5min":5.7990000000000004,"15min":16.082000000000001},"last":0.90400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575785,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":889164,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":888190,"kb_avail":93482676,"statfs":{"total":96636764160,"available":95726260224,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":909506827},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.88900000000000001,"5min":1.1970000000000001,"15min":1.2869999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.621,"15min":0.65700000000000003},"min":{"1min":0.28199999999999997,"5min":0.215,"15min":0.215},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.222},"max":{"1min":10.461,"5min":10.461,"15min":10.461},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.797000000000001,"5min":10.797000000000001,"15min":10.797000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63800000000000001,"15min":0.749},"min":{"1min":0.32800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":18.024999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75,"15min":0.83599999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.004,"5min":1.194,"15min":1.5289999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.999,"15min":1.02},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":9.2970000000000006,"5min":9.2970000000000006,"15min":9.2970000000000006},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.97499999999999998,"15min":0.97199999999999998},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":9.3710000000000004,"5min":9.3710000000000004,"15min":9.3710000000000004},"last":0.95199999999999996}]},{"osd":5,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":2.1600000000000001,"5min":1.147,"15min":1.016},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":32.418999999999997,"5min":32.418999999999997,"15min":32.418999999999997},"last":0.877},{"interface":"front","average":{"1min":2.2669999999999999,"5min":1.2470000000000001,"15min":1.149},"min":{"1min":0.42299999999999999,"5min":0.38300000000000001,"15min":0.34100000000000003},"max":{"1min":32.520000000000003,"5min":32.520000000000003,"15min":32.520000000000003},"last":1.0940000000000001}]},{"osd":6,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":1.125},"min":{"1min":0.377,"5min":0.377,"15min":0.371},"max":{"1min":4.4989999999999997,"5min":4.4989999999999997,"15min":4.4989999999999997},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.056,"15min":1.109},"min":{"1min":0.47499999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":6.3109999999999999},"last":0.97199999999999998}]},{"osd":7,"last update":"Wed Jan 24 14:01:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.044,"15min":1.103},"min":{"1min":0.55000000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":6.3760000000000003},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.03},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4450000000000001,"5min":1.4950000000000001,"15min":1.655},"last":1.0680000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-24T14:01:44.141 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-24T14:01:44.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.249+0000 7faa6c694640 1 Processor -- start 2024-01-24T14:01:44.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.249+0000 7faa6c694640 1 -- start start 2024-01-24T14:01:44.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa6414dea0 0x7faa640b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640b82e0 con 0x7faa64069f80 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- --> v1:172.21.15.124:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640700b0 con 0x7faa6406fc40 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64070380 con 0x7faa6414dea0 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa69c2f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7faa6414dea0 0x7faa640b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6a430640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7faa64069f80 0x7faa640b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34380/0 (socket says 172.21.15.27:34380) 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6a430640 1 -- 172.21.15.27:0/3223797266 learned_addr learned my addr 172.21.15.27:0/3223797266 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa69c2f640 1 -- 172.21.15.27:0/3223797266 >> v1:172.21.15.124:6789/0 conn(0x7faa6406fc40 legacy=0x7faa641447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa69c2f640 1 -- 172.21.15.27:0/3223797266 >> v1:172.21.15.27:6789/0 conn(0x7faa64069f80 legacy=0x7faa640b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6942e640 1 -- 172.21.15.27:0/3223797266 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222278023 0 0) 0x7faa640b82e0 con 0x7faa64069f80 2024-01-24T14:01:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa69c2f640 1 -- 172.21.15.27:0/3223797266 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64070660 con 0x7faa6414dea0 2024-01-24T14:01:44.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa69c2f640 1 --2- 172.21.15.27:0/3223797266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6414dea0 0x7faa640b3c30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7faa540097c0 tx=0x7faa5401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93883c155c22c197 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6942e640 1 -- 172.21.15.27:0/3223797266 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540a8970 con 0x7faa6414dea0 2024-01-24T14:01:44.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6942e640 1 -- 172.21.15.27:0/3223797266 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa540a8ad0 con 0x7faa6414dea0 2024-01-24T14:01:44.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6942e640 1 -- 172.21.15.27:0/3223797266 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540a8e60 con 0x7faa6414dea0 2024-01-24T14:01:44.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- 172.21.15.27:0/3223797266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6414dea0 msgr2=0x7faa640b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 --2- 172.21.15.27:0/3223797266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6414dea0 0x7faa640b3c30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7faa540097c0 tx=0x7faa5401ec70 comp rx=0 tx=0).stop 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- 172.21.15.27:0/3223797266 shutdown_connections 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 --2- 172.21.15.27:0/3223797266 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa6414dea0 0x7faa640b3c30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- 172.21.15.27:0/3223797266 >> 172.21.15.27:0/3223797266 conn(0x7faa640bcf70 msgr2=0x7faa640bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- 172.21.15.27:0/3223797266 shutdown_connections 2024-01-24T14:01:44.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.253+0000 7faa6c694640 1 -- 172.21.15.27:0/3223797266 wait complete. 2024-01-24T14:01:44.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 Processor -- start 2024-01-24T14:01:44.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- start start 2024-01-24T14:01:44.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa6406fc40 0x7faa64133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa6414dea0 0x7faa64134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640b8c30 con 0x7faa64069f80 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641415d0 con 0x7faa6406fc40 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6414c290 con 0x7faa6414dea0 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48648/0 (socket says 172.21.15.27:48648) 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 -- 172.21.15.27:0/3865756986 learned_addr learned my addr 172.21.15.27:0/3865756986 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:44.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 -- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa6414dea0 msgr2=0x7faa64134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa6414dea0 0x7faa64134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 -- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa6406fc40 msgr2=0x7faa64133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa6406fc40 0x7faa64133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 -- 172.21.15.27:0/3865756986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009420 con 0x7faa64069f80 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6a430640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600075a0 con 0x7faa64069f80 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa600047f0 con 0x7faa64069f80 2024-01-24T14:01:44.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6414bd40 con 0x7faa64069f80 2024-01-24T14:01:44.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60004ba0 con 0x7faa64069f80 2024-01-24T14:01:44.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6413ce00 con 0x7faa64069f80 2024-01-24T14:01:44.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6404e000 con 0x7faa64069f80 2024-01-24T14:01:44.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.257+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa60004d00 con 0x7faa64069f80 2024-01-24T14:01:44.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.261+0000 7faa5affd640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.261+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faa60082320 con 0x7faa64069f80 2024-01-24T14:01:44.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.261+0000 7faa69c2f640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.261+0000 7faa69c2f640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 0x7faa48067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faa540b2000 tx=0x7faa54004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.265+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7faa60050070 con 0x7faa64069f80 2024-01-24T14:01:44.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.417+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7faa6413aaf0 con 0x7faa64069f80 2024-01-24T14:01:44.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.421+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa60050070 con 0x7faa64069f80 2024-01-24T14:01:44.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa5affd640 1 -- 172.21.15.27:0/3865756986 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7faa60053690 con 0x7faa64069f80 2024-01-24T14:01:44.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 msgr2=0x7faa48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 0x7faa48067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faa540b2000 tx=0x7faa54004740 comp rx=0 tx=0).stop 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 msgr2=0x7faa64141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).stop 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 shutdown_connections 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7faa48065a60 0x7faa48067f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7faa6414dea0 0x7faa64134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7faa6406fc40 0x7faa64133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 --2- 172.21.15.27:0/3865756986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faa64069f80 0x7faa64141090 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 >> 172.21.15.27:0/3865756986 conn(0x7faa640bcf70 msgr2=0x7faa640ba130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 shutdown_connections 2024-01-24T14:01:44.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.425+0000 7faa6c694640 1 -- 172.21.15.27:0/3865756986 wait complete. 2024-01-24T14:01:44.444 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-24T14:01:44.444 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T14:01:44.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 Processor -- start 2024-01-24T14:01:44.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 -- start start 2024-01-24T14:01:44.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ebc06a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 --2- >> v2:172.21.15.124:3300/0 conn(0x7f0ebc0b3b10 0x7f0ebc155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0702c0 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 -- --> v2:172.21.15.124:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b8650 con 0x7f0ebc0b3b10 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ec1f8c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc06ff50 con 0x7f0ebc069d20 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ebaffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0ebc0b81c0 0x7f0ebc14a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34396/0 (socket says 172.21.15.27:34396) 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.553+0000 7f0ebaffd640 1 -- 172.21.15.27:0/3410731511 learned_addr learned my addr 172.21.15.27:0/3410731511 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/3410731511 >> v2:172.21.15.124:3300/0 conn(0x7f0ebc0b3b10 0x7f0ebc155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebb7fe640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ebc06a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747455924 0 0) 0x7f0ebc0702c0 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003530 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060643624 0 0) 0x7f0ea8003530 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 msgr2=0x7f0ebc06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ebc06a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 >> v2:172.21.15.124:3300/0 conn(0x7f0ebc0b3b10 msgr2=0x7f0ebc155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 --2- 172.21.15.27:0/3410731511 >> v2:172.21.15.124:3300/0 conn(0x7f0ebc0b3b10 0x7f0ebc155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc14b0f0 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 990861964 0 0) 0x7f0ea4001680 con 0x7f0ebc0b81c0 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 >> v1:172.21.15.27:6789/0 conn(0x7f0ebc0b81c0 legacy=0x7f0ebc14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ea8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea8003f00 0x7f0ea80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b8650 con 0x7f0ea8004d10 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc06ff50 con 0x7f0ea8003f00 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800b990 con 0x7f0ebc069d20 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea8003f00 0x7f0ea80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 -- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 msgr2=0x7f0ea8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebb7fe640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ea8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc069d20 0x7f0ea8003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 -- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea8003f00 msgr2=0x7f0ea80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea8003f00 0x7f0ea80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 -- 172.21.15.27:0/3410731511 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8003530 con 0x7f0ea8004d10 2024-01-24T14:01:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ea8003f00 0x7f0ea80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fc0 tx=0x7f0eb401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc33d89b6f0ee51 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40a5cb0 con 0x7f0ea8004d10 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0eb400f040 con 0x7f0ea8004d10 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0eba7fc640 1 -- 172.21.15.27:0/3410731511 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40ad6a0 con 0x7f0ea8004d10 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/3410731511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 msgr2=0x7f0ea8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/3410731511 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fc0 tx=0x7f0eb401cc40 comp rx=0 tx=0).stop 2024-01-24T14:01:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ebbfff640 1 -- 172.21.15.27:0/3410731511 reap_dead start 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/3410731511 shutdown_connections 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.557+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/3410731511 >> 172.21.15.27:0/3410731511 conn(0x7f0ebc06ae30 msgr2=0x7f0ebc06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/3410731511 shutdown_connections 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/3410731511 wait complete. 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 Processor -- start 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- start start 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 --2- >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 0x7f0ebc0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 --2- >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 0x7f0ebc1e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b57b0 con 0x7f0ea8004d10 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- --> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b5d00 con 0x7f0ebc13fdc0 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- --> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b5fa0 con 0x7f0ebc140240 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48672/0 (socket says 172.21.15.27:48672) 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 -- 172.21.15.27:0/49588726 learned_addr learned my addr 172.21.15.27:0/49588726 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 0x7f0ebc0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 0x7f0ebc1e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 -- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 msgr2=0x7f0ebc1e01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 0x7f0ebc1e01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 -- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 msgr2=0x7f0ebc0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 0x7f0ebc0b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 -- 172.21.15.27:0/49588726 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0b6280 con 0x7f0ea8004d10 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 0x7f0ebc0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebbfff640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 0x7f0ebc1e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T14:01:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ebb7fe640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0eac010890 tx=0x7f0eac010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac009630 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0eac00eb60 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc0b6560 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac01c400 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc147e80 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.561+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc04e000 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.565+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0eac01c560 con 0x7f0ea8004d10 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.565+0000 7f0eb3fff640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 0x7f0e9c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T14:01:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.565+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0eac0836b0 con 0x7f0ea8004d10 2024-01-24T14:01:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.565+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 0x7f0e9c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T14:01:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.565+0000 7f0ebaffd640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 0x7f0e9c067f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc14bdb0 tx=0x7f0ea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T14:01:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.569+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172184 (secure 0 0 0) 0x7f0eac051450 con 0x7f0ea8004d10 2024-01-24T14:01:44.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ebc0b7fa0 con 0x7f0ea8004d10 2024-01-24T14:01:44.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0eb3fff640 1 -- 172.21.15.27:0/49588726 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2775 (secure 0 0 0) 0x7f0eac054a70 con 0x7f0ea8004d10 2024-01-24T14:01:44.755 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-24T14:01:44.756 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.124:6835/3782978433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.124:6834","nonce":3782978433},{"type":"v1","addr":"172.21.15.124:6835","nonce":3782978433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/2035905163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":2035905163},{"type":"v1","addr":"172.21.15.27:6834","nonce":2035905163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":6747,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2779194710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":2779194710},{"type":"v1","addr":"172.21.15.27:6835","nonce":2779194710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2024-01-24T14:01:44.758 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 15 2024-01-24T14:01:44.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 msgr2=0x7f0e9c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 0x7f0e9c067f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc14bdb0 tx=0x7f0ea4009040 comp rx=0 tx=0).stop 2024-01-24T14:01:44.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 msgr2=0x7f0ebc14e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T14:01:44.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0eac010890 tx=0x7f0eac010d50 comp rx=0 tx=0).stop 2024-01-24T14:01:44.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 shutdown_connections 2024-01-24T14:01:44.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:6832/27368,v1:172.21.15.124:6833/27368] conn(0x7f0e9c065a90 0x7f0e9c067f50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3301/0,v1:172.21.15.124:6790/0] conn(0x7f0ebc140240 0x7f0ebc1e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.124:3300/0,v1:172.21.15.124:6789/0] conn(0x7f0ebc13fdc0 0x7f0ebc0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 --2- 172.21.15.27:0/49588726 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ea8004d10 0x7f0ebc14e570 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T14:01:44.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 >> 172.21.15.27:0/49588726 conn(0x7f0ebc06ae30 msgr2=0x7f0ebc0b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T14:01:44.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 shutdown_connections 2024-01-24T14:01:44.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-24T14:01:44.753+0000 7f0ec1f8c640 1 -- 172.21.15.27:0/49588726 wait complete. 2024-01-24T14:01:44.772 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-24T14:01:44.773 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-24T14:01:44.773 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-24T14:01:44.773 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:44.786 INFO:tasks.ceph.mds.a:Stopped 2024-01-24T14:01:44.786 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-24T14:01:44.787 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:44.846 INFO:tasks.ceph.mds.c:Stopped 2024-01-24T14:01:44.846 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-24T14:01:44.846 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:44.860 INFO:tasks.ceph.mds.b:Stopped 2024-01-24T14:01:44.860 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-24T14:01:44.860 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-24T14:01:44.861 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:50.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-24T14:01:50.962 INFO:tasks.ceph.osd.0:Stopped 2024-01-24T14:01:50.963 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-24T14:01:50.963 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:57.065 INFO:tasks.ceph.osd.1:Stopped 2024-01-24T14:01:57.065 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-24T14:01:57.065 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:01:57.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-24T14:01:57.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-24T14:01:57.148 INFO:tasks.ceph.osd.2:Stopped 2024-01-24T14:01:57.148 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-24T14:01:57.148 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:02.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-24T14:02:02.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-24T14:02:03.250 INFO:tasks.ceph.osd.3:Stopped 2024-01-24T14:02:03.425 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-24T14:02:03.425 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:08.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-24T14:02:08.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-24T14:02:09.527 INFO:tasks.ceph.osd.4:Stopped 2024-01-24T14:02:09.528 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-24T14:02:09.528 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:09.621 INFO:tasks.ceph.osd.5:Stopped 2024-01-24T14:02:09.621 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-24T14:02:09.621 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:14.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-24T14:02:14.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-24T14:02:15.723 INFO:tasks.ceph.osd.6:Stopped 2024-01-24T14:02:15.724 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-24T14:02:15.724 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:19.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-24T14:02:19.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-24T14:02:21.825 INFO:tasks.ceph.osd.7:Stopped 2024-01-24T14:02:21.826 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-24T14:02:21.826 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-24T14:02:21.826 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:21.861 INFO:tasks.ceph.mgr.y:Stopped 2024-01-24T14:02:21.861 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-24T14:02:21.861 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:21.892 INFO:tasks.ceph.mgr.x:Stopped 2024-01-24T14:02:21.892 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-24T14:02:21.892 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-24T14:02:21.892 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:21.922 INFO:tasks.ceph.mon.a:Stopped 2024-01-24T14:02:21.923 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-24T14:02:21.923 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:21.950 INFO:tasks.ceph.mon.b:Stopped 2024-01-24T14:02:21.951 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-24T14:02:21.951 INFO:teuthology.orchestra.run:waiting for 300 2024-01-24T14:02:22.020 INFO:tasks.ceph.mon.c:Stopped 2024-01-24T14:02:22.020 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-24T14:02:22.020 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-24T14:02:22.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T14:02:22.081 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-24T14:02:22.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T14:02:22.592 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-24T14:02:22.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T14:02:22.881 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-24T14:02:23.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T14:02:23.211 DEBUG:teuthology.orchestra.run.smithi027:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-24T14:02:23.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T14:02:23.409 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-24T14:02:23.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T14:02:23.781 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-24T14:02:23.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T14:02:23.986 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-24T14:02:24.171 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T14:02:24.171 DEBUG:teuthology.orchestra.run.smithi124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-24T14:02:24.368 INFO:tasks.ceph:Archiving mon data... 2024-01-24T14:02:24.370 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/data/mon.a.tgz 2024-01-24T14:02:24.370 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-01-24T14:02:24.396 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.hPqUCL2NW5 2024-01-24T14:02:24.396 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hPqUCL2NW5 2024-01-24T14:02:24.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.hPqUCL2NW5 2024-01-24T14:02:24.628 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.hPqUCL2NW5 is 288KB 2024-01-24T14:02:24.688 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.hPqUCL2NW5 2024-01-24T14:02:24.693 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/data/mon.b.tgz 2024-01-24T14:02:24.694 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2024-01-24T14:02:24.721 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.FHmryDhofE 2024-01-24T14:02:24.722 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FHmryDhofE 2024-01-24T14:02:24.845 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.FHmryDhofE 2024-01-24T14:02:24.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-24T14:02:24.980 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.FHmryDhofE is 293KB 2024-01-24T14:02:25.041 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.FHmryDhofE 2024-01-24T14:02:25.067 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/data/mon.c.tgz 2024-01-24T14:02:25.067 DEBUG:teuthology.orchestra.run.smithi124:> mktemp 2024-01-24T14:02:25.116 INFO:teuthology.orchestra.run.smithi124.stdout:/tmp/tmp.6dbS8KIasv 2024-01-24T14:02:25.116 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6dbS8KIasv 2024-01-24T14:02:25.226 DEBUG:teuthology.orchestra.run.smithi124:> sudo chmod 0666 /tmp/tmp.6dbS8KIasv 2024-01-24T14:02:25.287 DEBUG:teuthology.orchestra.remote:smithi124:/tmp/tmp.6dbS8KIasv is 293KB 2024-01-24T14:02:25.345 DEBUG:teuthology.orchestra.run.smithi124:> rm -fr /tmp/tmp.6dbS8KIasv 2024-01-24T14:02:25.350 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-24T14:02:25.350 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-24T14:02:25.353 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-24T14:02:25.396 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-24T14:02:25.424 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-01-24T14:02:25.425 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-24T14:02:25.430 DEBUG:teuthology.orchestra.run.smithi124:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-24T14:02:25.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-24T14:02:25.467 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-24T14:02:25.483 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-24T14:02:25.509 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-24T14:02:25.517 INFO:tasks.ceph:Archiving crash dumps... 2024-01-24T14:02:25.519 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi027/crash 2024-01-24T14:02:25.520 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-24T14:02:25.529 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi124/crash 2024-01-24T14:02:25.530 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-24T14:02:25.542 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi195/crash 2024-01-24T14:02:25.543 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-24T14:02:25.599 INFO:tasks.ceph:Shutting down logrotate 2024-01-24T14:02:27.558 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-24T14:02:27.590 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-24T14:02:27.689 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-24T14:02:27.711 INFO:tasks.ceph:Compressing logs... 2024-01-24T14:02:27.711 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:02:27.713 DEBUG:teuthology.orchestra.run.smithi124:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:02:27.715 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:07:18.372 INFO:tasks.ceph:Archiving logs... 2024-01-24T14:07:18.373 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi027/log 2024-01-24T14:07:18.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T14:09:03.367 DEBUG:teuthology.misc:Transferring archived files from smithi124:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi124/log 2024-01-24T14:09:03.368 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T14:09:27.792 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi195/log 2024-01-24T14:09:27.793 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T14:09:28.815 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-24T14:09:28.861 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-24T14:09:28.862 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T14:09:28.864 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T14:09:28.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T14:09:28.955 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-24T14:09:28.966 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-24T14:09:28.966 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T14:09:28.968 DEBUG:teuthology.orchestra.run.smithi124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T14:09:28.971 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T14:09:29.017 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T14:09:29.018 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-01-24T14:09:29.018 INFO:teuthology.orchestra.run.smithi027.stdout:*hv01.front.sepi 44.4.53.2 2 u 116 128 377 0.190 -1.531 0.330 2024-01-24T14:09:29.018 INFO:teuthology.orchestra.run.smithi027.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 128 377 0.165 -1.715 0.609 2024-01-24T14:09:29.018 INFO:teuthology.orchestra.run.smithi027.stdout:+hv03.front.sepi 74.6.168.72 3 u 129 128 377 0.150 -1.162 0.708 2024-01-24T14:09:29.018 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout:============================================================================== 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout:*hv01.front.sepi 44.4.53.2 2 u 81 256 377 0.173 -2.242 0.254 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout:+hv02.front.sepi 63.231.80.2 3 u 98 256 377 0.157 -2.860 0.318 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout:+hv03.front.sepi 74.6.168.72 3 u 205 256 377 0.177 -1.691 0.631 2024-01-24T14:09:29.195 INFO:teuthology.orchestra.run.smithi124.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-24T14:09:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-01-24T14:09:29.313 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-01-24T14:09:29.313 INFO:teuthology.orchestra.run.smithi195.stdout:*hv01.front.sepi 44.4.53.2 2 u 28 64 377 0.114 -0.167 0.214 2024-01-24T14:09:29.314 INFO:teuthology.orchestra.run.smithi195.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 377 0.125 -0.866 0.221 2024-01-24T14:09:29.314 INFO:teuthology.orchestra.run.smithi195.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.076 -0.482 0.151 2024-01-24T14:09:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-24T14:09:29.315 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-24T14:09:29.325 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-24T14:09:29.325 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-24T14:09:29.337 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-24T14:09:29.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-24T14:09:29.361 INFO:teuthology.task.internal:Duration was 5785.426996 seconds 2024-01-24T14:09:29.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-24T14:09:29.373 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-24T14:09:29.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T14:09:29.376 DEBUG:teuthology.orchestra.run.smithi124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T14:09:29.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T14:09:29.592 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-24T14:09:29.592 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-01-24T14:09:29.593 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T14:09:29.604 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi124.front.sepia.ceph.com 2024-01-24T14:09:29.604 DEBUG:teuthology.orchestra.run.smithi124:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T14:09:29.615 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-01-24T14:09:29.615 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T14:09:29.693 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-24T14:09:29.694 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:09:29.696 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:09:29.699 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T14:09:29.824 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-24T14:09:29.825 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T14:09:29.827 DEBUG:teuthology.orchestra.run.smithi124:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T14:09:29.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T14:09:30.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-24T14:09:30.155 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-24T14:09:30.156 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T14:09:30.187 DEBUG:teuthology.orchestra.run.smithi124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T14:09:30.236 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T14:09:30.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-24T14:09:30.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.293 DEBUG:teuthology.orchestra.run.smithi124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.299 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.322 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-01-24T14:09:30.323 INFO:teuthology.orchestra.run.smithi124.stdout:kernel.core_pattern = core 2024-01-24T14:09:30.378 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-01-24T14:09:30.408 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T14:09:30.416 DEBUG:teuthology.orchestra.run.smithi124:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T14:09:30.422 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T14:09:30.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T14:09:30.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-24T14:09:30.450 INFO:teuthology.task.internal:Transferring archived files... 2024-01-24T14:09:30.452 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi027 2024-01-24T14:09:30.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T14:09:30.488 DEBUG:teuthology.misc:Transferring archived files from smithi124:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi124 2024-01-24T14:09:30.489 DEBUG:teuthology.orchestra.run.smithi124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T14:09:30.513 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766/remote/smithi195 2024-01-24T14:09:30.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T14:09:30.548 INFO:teuthology.task.internal:Removing archive directory... 2024-01-24T14:09:30.548 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T14:09:30.551 DEBUG:teuthology.orchestra.run.smithi124:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T14:09:30.553 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T14:09:30.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-24T14:09:30.601 INFO:teuthology.task.internal:Not uploading archives. 2024-01-24T14:09:30.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-24T14:09:30.612 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-24T14:09:30.612 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T14:09:30.614 DEBUG:teuthology.orchestra.run.smithi124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T14:09:30.616 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T14:09:30.618 INFO:teuthology.orchestra.run.smithi027.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 14:09 /home/ubuntu/cephtest 2024-01-24T14:09:30.620 INFO:teuthology.orchestra.run.smithi124.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 14:09 /home/ubuntu/cephtest 2024-01-24T14:09:30.641 INFO:teuthology.orchestra.run.smithi195.stdout: 658083 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 14:09 /home/ubuntu/cephtest 2024-01-24T14:09:30.643 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-24T14:09:30.655 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-24T14:09:30.691 INFO:teuthology.nuke:Checking targets against current locks 2024-01-24T14:09:30.718 DEBUG:teuthology.nuke:shortname: smithi027 2024-01-24T14:09:30.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T14:09:30.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.320670', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb31wdFe43Aa1vv7AEA/QSS11EbYkPsRg6DNznaQFtnvf/bWnxCrBiTddAC0G+za/PQ04nzCVHVUNNraA5qS2s='} 2024-01-24T14:09:30.746 DEBUG:teuthology.nuke:shortname: smithi124 2024-01-24T14:09:30.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T14:09:30.768 DEBUG:teuthology.nuke:shortname: smithi195 2024-01-24T14:09:30.769 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T14:09:30.772 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.318735', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBYZXbSRKtQbZIY8FOmZayvljdcrmTZ7kaFekOw3RtcO4qEoNCzhffAzxhdj5acEknJks6DwIhW0qI+XZI+Z1A='} 2024-01-24T14:09:30.790 INFO:teuthology.orchestra.console.smithi027:Power off 2024-01-24T14:09:30.790 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T14:09:30.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530766', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 12:23:04.322008', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBPTmx7D2773Re/JDDuKb7FpIvc3l3oC1VzTSxIXrngDhgF2fmGOLFnXOiuZTOp4ZZ2WyxeAXw3wz8LHItMATaM='} 2024-01-24T14:09:30.819 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-01-24T14:09:30.819 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:30.838 INFO:teuthology.orchestra.console.smithi124:Power off 2024-01-24T14:09:30.838 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T14:09:30.851 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-01-24T14:09:30.861 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2024-01-24T14:09:30.861 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:30.878 INFO:teuthology.orchestra.console.smithi195:Power off 2024-01-24T14:09:30.879 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T14:09:30.889 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-24T14:09:30.902 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-01-24T14:09:30.902 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:30.928 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-24T14:09:34.852 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:34.890 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:34.929 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:34.964 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-01-24T14:09:35.000 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-24T14:09:35.040 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-01-24T14:09:38.968 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:39.001 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:39.041 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:39.078 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-01-24T14:09:39.112 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2024-01-24T14:09:39.150 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-01-24T14:09:39.250 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-01-24T14:09:43.080 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:43.113 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T14:09:43.190 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-01-24T14:09:43.223 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2024-01-24T14:09:43.291 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-01-24T14:09:43.324 INFO:teuthology.orchestra.console.smithi124:Power off completed 2024-01-24T14:09:43.430 INFO:teuthology.run:Summary data: client.0-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 5785.426996231079 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=223e4bec483243ca804b5184215a73cc status: fail success: false 2024-01-24T14:09:43.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T14:09:43.528 INFO:teuthology.run:FAIL